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LXECt  TIVt  SUMMARY 


Thi&  pa[)er  assesses  ihe  pfoc«&s  ca^iabdiibes  and  cotnpeienctes  of  Air  Force 
Maienal  Command’s  (AFMC)  Air  Logisibcs  Center  (ALCj  ai  Tinker  AFB.  OK  The 
asseesmeni  use^  a  cross-secitonal  questionnaire  covering  contracting  [irocesses  and 
procedures.  The  purpose  of  this  study  is  to  analyze  the  ALC’s  contracting  processes  and 
procedures  lo  better  establish  a  baseline  for  coniraci  managemeni  maturity  Using  the 
Contract  Management  Maturity  Model  (CMMMl  and  its  assessment  tool,  this  model  will 
be  used  to  identify  the  ALC's  weak,  as  well  as  strong,  contract  managemeni  processes, 
and  10  provide  recommendations  for  improving  the  maturity  of  these  processes 
Additionally,  the  Learning  Organization  Assessment  mode!  is  used  to  determine  which 
characteristics  of  a  learning  organization  the  ALCs  possess.  The  results  of  these 
assessments  will  be  used  to  determine  any  correlation  between  the  two  models  and  to 
recommend  areas  tor  organizational  improvement 

The  contract  management  assessment  was  conducted  at  both  the  Aircraft 
Sustainment  Wing  (ASW)  and  Combat  Sustainment  Wing  (CSW)  levels  as  well  as  the 
overall  enterprise  level.  The  contract  managemeni  maturity  assessment  at  the  enterprise 
level  resulted  in  a  “Basic”  maiunty  level  for  the  key  process  area  of  Procurement 
Planning;  a  “Structured”  maturity  level  for  the  key  process  areas  of  Solicitation  Planning, 
Soliciiaiion,  and  Source  Selection;  and  an  "Ad-Hoc”  marurity  level  for  the  key  process 
areas  of  Contract  Administration  and  Contract  Closeout.  The  overall  results  of  the 
Learning  Organization  assessment  for  the  enterprise  were  ^irly  flat  showing  neither 
strength  nor  a  weakness  expressing  characteristics  of  a  learning  organization.  The 
enterprise  received  an  average  rating  across  the  Seven  Steps  consisting  of  AssessmenL 
Promote  the  Positive,  Safe  Thinking,  Risk-Taking.  People  as  Resources,  Learning  Power, 
and  Get  the  Show  on  the  Road  The  Steps  that  were  assessed  the  lowest  and  offer  the 
greatest  opportunities  for  improvement  were'  Step  7'  Map  out  the  Vision,  Step  S;  Bnng 
the  Vision  to  Life,  and  Step  9;  Connect  the  Systems.  The  research  concludes  with 
recommendations  for  the  ALC  for  improving  ns  contract  management  processes  and 
learning  organization  characteristics 
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I. 


INIRODtCTlON 


A.  BACKGROUND  INFORMATION 

Air  Fofce  Material  Command  (AFMC)  is  the  Air  Force's  major  focal  poini  for  al) 
acquisiiion  and  procurement  actions.  The  command  supports  more  than  6,400  aircraft 
and  29,500  engines,  operates  13  bases,  and  commands  the  Air  Force's  medical  and  test 
pilot  schools  (Air  Force  Materiel  Command.  2007).  AFMC  has  well  over  100.000 
military,  civilian,  and  contractor  personnel.  One  peculiahry  of  AFMC  as  compared  to 
other  Major  Commands  (MAJCGMs)  is  the  staggering  difference  m  personnel.  The 
dilTerence  lays  within  the  breakdown  of  the  workforce — more  specifically  the  large 
percentage  of  civilian  employees  (refer  to  Table  1  belowV 


Civilian 

56% 

Contractor 

26% 

Military 

1  S% 

Table  I.  Workforce  Breakdown 


(From  Veme2,  2007) 


AFMC's  mission  is  to; 

Deliver  war-winning  expeditionary  capabilities  to  the  warlighter  through 
development  and  transition  of  technology,  professional  acquisition 
management,  exacting  test  and  evaluation,  and  world-class  sustainment  of 
all  Air  Force  weapon  systems.  From  cradle  to  grave,  AFMC  provides  the 
workforce  and  mhostmcture  necessary  to  ensure  the  United  States  remains 
the  world’s  most  respected  Air  and  Space  Force.  (Air  Force  Materiel 
Command,  2007) 

To  satisiy  this  mission,  AFMC  has  fashioned  an  onslaught  of  initiatives'  Air  Force  Smart 
Operations  for  the  2I'‘  century  (AFS021),  Force  Shaping,  and  numerous  aircraft 
retirements  In  essence,  the  Air  Force  is  re-capitalizing  in  order  to  deal  with  the  loss  of 
overall  buying  power  by  trading -off  personnel  for  aircratl,  along  with  other  initiatives,  to 
maintain  its  lethality. 


I 


In  order  lo  reoch  ihe  2025  force  sinjcture  objective,  all  test  organizaiions, 
coniracimg  onkes,  and  logistics  centers  are  implementing  their  own  iniiiaiives.  Tinker 
Air  Force  Base,  Oklahoma,  is  one  of  only  three  Air  Logistics  Centers  (ALCs)  wiihm 
APMC;  the  other  two  are  Robbins  AFB,  Georgia,  and  Hill  AFB,  Utah  Tinker  Air  Force 
Base  has  been  a  critical  component  of  America's  national  defense  since  its  creation  as  a 
maintenance  and  supply  depot  in  1941.  Today,  it  is  home  to  the  Oklahoma  City  Air 
Logistics  Center  and  several  major  associate  units,  including  the  SS2nd  Air  Control 
Wing,  the  Navy's  Strategic  Communications  Wing  One,  the  S07th  Air  Retiieiing  Wing, 
and  the  3rd  Combat  Communications  Group  With  more  than  26,000  military  and  civilian 
employees.  Tinker  is  the  largest  single-site  employer  in  Oklahoma  and  has  the  largest 
percentage  of  civilian  personnel  of  any  organi2aiion  within  AFMC  (Tinker  Air  Force 
Base,  2007).  Because  of  these  characteristics,  the  OC-ALC  is  a  prime  candidate  for 
assessing  CM  processe&'procedures  and  organi2aiional  learning  characienstics. 

B.  PURPOSE  OF  STUDY 

In  this  ever-changing  world,  the  Departmeni  of  Defense  (DoD)  is  positioning 
Itself  for  the  21*  century  through  procurement  and  outsourcing.  With  the  Navy  and  Air 
Force  reducing  their  aciive-duty  ranks  by  40,000  each,  more  and  more  jobs  previously 
performed  by  organic  support  are  being  performed  by  contractors  Also,  the  DoD  faces  a 
significani  loss  in  its  civil  service  corps  stemming  horn  force-shaping  and  the  retirement 
of  the  baby  boom  generation.  For  example,  the  Defense  Contract  Management  Agency 
(DCMA)  IS  being  a  loss  of  nearly  75%  of  its  civil  service  personnel,  who  specialize  in 
conu^iing  administration,  within  the  next  five  years  (Echols,  2007) 

This  loss  of  personnel  is  creating  a  significant  gap  in  the  corporate  knowledge  of 
the  contracting  community.  Continuity,  which  is  key  lo  this  community,  will  be  lost  if 
the  DoD  does  not  implement  measures  that  transfer  corporate  knowledge  horn  the  baby 
boomers  to  their  replacements.  In  the  book  Managing  m  Turhuleni  Time.%  (19fl0),  Peier 
Drucker  states  that,  “You  manage  the  fundamentals  and  you  manage  them  weir  (p.  9) 
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TtK  Ajnd^enuU  in  this  case  are  coniracimg  processes  and  procedures  dial  ihe  DoD,  and 
more  specifically,  the  USAP,  uses  to  maintain  us  compeiiiive  edge  of  being  ihe  deadliest 
Air  Force  in  the  world. 

The  purpose  of  ihis  study  is  to  anaty2e  Tinker  Air  Force  Base's  Oklahoma  City 
Air  Logistics  Center’s  (OC-ALC’s)  contracting  processes  and  knowledge  management 
practices.  The  researchers  will  apply  the  Contract  Management  Maturity  Model 
(CMMM)  and  administer  the  survey  entitled  “Learning  Organizational  Assessment.” 
The  results  from  the  surveys  will  be  used  in  determining  target  areas  for  improvement 
and  will  show  the  correlation  or  contradiction  of  the  results  from  both  models. 

C.  PROBLEM  ST ATEM  ENT 

The  Air  Logistic  Center's  high  concentration  of  retirement  eligible  civilian 
employees  creates  several  issues  One  of  which  is  a  wide  gap  in  experience  levels 
making  it  difficult  for  Junior  civilians  to  fill  higher  level  positions  The  OC-ALC  needs 
to  have  processes  in  place  to  limit  the  impending  loss  in  corporate  knowledge  as  many 
personnel  are  on  the  verge  of  leaving  the  organization.  These  processes  will  posture  the 
ALC  to  handle  the  impending  high  turnover  of  its  civilian  workforce.  Further,  these 
mature  processes  can  be  adapted  and  modified  to  position  the  ALC  for  future  workforce 
initiatives  designed  to  capture  and  maintain  corporate  knowledge.  As  Dr.  Rene  Rendon 
(CPCM,  CPM,  and  PMP)  adeptly  stated,  “Contracts  are  only  as  good  as  the  processes 
that  are  used  to  develop  them;  if  knowledge  does  not  flow,  contracts  will  not  flow” 
(personal  communication,  September  23,  2007). 

D.  CONCEPTUAL  FRAMEWORK 

There  are  a  multitude  of  procurement  agencies  within  the  DoD,  and  the  USAF  in 
particular,  that  require  hundreds  of  millions  of  dollars  in  equipment  and  support.  Like 
most  government  organizations,  the  Air  Force  has  been  subjected  to  its  fair  share  of 
budget  and  personnel  cuts.  'This  research  will  help  determine  if  the  USAF's  current 
administrative  practices  In  contract  and  knowledge  management  are  effective  in  the 
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regulation  of  its  resources.  TM  models  will  also  review  curreni  [policies  and  [iroceilures 
and  determine  [possible  changes,  if  necessary. 

The  contract  managemeni  leadership  at  ihe  OC-ALC  can  derive  many  benefits 
ftom  these  conceptual  models’  measurement  of  their  capabilities,  especially  when 
functions  are  being  miegraied  throughout  the  organization.  The  framework  utilized  for 
this  purpose  is  composed  of  ihe  Contract  Management  Maturity  Model  (CMMM)  and  an 
application  of  a  knowledge  management  survey  adapted  from  Ten  Sups  to  a  Leunxin^ 
Or^ntzaxUm.  as  presented  by  Peter  Kline  and  Bernard  Saunders  (19931.  These  models 
can  assist  the  ALC  with  other  assessment  tools,  such  as  self-inspections,  unit-compliance 
inspections,  and  operauonal-readiness  inspections.  Additionally,  these  models  can  be 
leveraged  for  the  OC-ALC's  preparation  for  the  DoD  Human  Capital  Su^egic  Plan  that 
is  to  be  implemented  next  year. 

E,  ElESE A  RCH  QUESTIONS 

This  study  assesses  the  matuniy  of  the  Oklahoma  City  ALC’s  contract 
management  processes  and  examines  specilic  aspects  of  the  knowledge  management 
practices.  For  purposes  of  this  research,  the  term  '‘marunty’'  can  be  best  defined  as  the 
“full  development  or  a  perfected  condmon"  (“Maturity,”  2007).  The  connotatKin  of 
maturity  also  implies  a  general  knowledge  and  understanding  of  what  it  takes  to  prevent 
problems  and  achieve  success  (Oarrett  &  Rendon,  ZOOS). 

Using  the  CMMM,  a  maturity  level  can  be  assigned  to  each  CM  subordinate 
group  within  the  Aircraft  Sustainment  Wing  (ASW)  and  the  Combat  Sustainment  Wing 
(CSW).  Due  to  the  DoD' s  current  workforce  dilemma,  the  researchers  thought  it  prudent 
to  use  the  Learning  Organizational  Assessment.  In  order  to  determine  what  is  needed  for 
a  corporation/agency  to  become  a  true  learning  organization,  the  Learning  Organization 
Assessment  will  analyze  which  of  the  learning  organization  characteristics  the  OC-ALC 
currently  possesses.  Through  the  combination  of  the  CMMM  and  Learning  Organization 
Assessment  structures,  the  following  research  questions  are  addressed  in  this  study; 
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1  I  low  can  ctK  CMMM  and  knowledge  management  looU  aseisi  (he  DC-ALC's 
contract  managemeni  division? 

2  How  mature  are  the  OC-ALC’s  contraci  processes  and  procedures’^ 

3  Whai  are  (he  OC-ALC’s  organi2aiional  learning  charac(ens(ics? 

4  How  much  of  a  correlacion  ts  (here  between  the  ALC’s  con(rac(  managemeni 
macunty  and  its  organizadonal  learning  charac(ensrics'' 

5  To  what  degree  can  (he  OC-ALC  leverage  i(s  knowledge  managemen(  tn  other 
DoD  initiatives? 

6  Are  there  areas  for  improvement  based  on  these  frameworks,  and  specitically. 
what  actions  can  the  ALC  take  (o  improve? 

F.  N ATU  RE  OF  STUDY 

This  study  assesses  the  process  capabilities  and  competencies  of  the  OC-ALC 
The  CMMM  uses  a  cross-sectional  questionnaire  covering  contracting  processes,  while 
the  knowledge  management  mode)  evaluates  learning  managemeni  practices  The 
questionnaire  will  be  administered  to  a  select  group  of  contract  professionals  within  the 
OC-ALC — with  two  requirements.  The  first  requirement  for  panicipaiion  in  the  study  is 
the  successful  completion  of  (he  requirements  for  DeJ^nse  AcquixiUon  Workfotve 
Imptovtmen!  Ad  {DAWAf)  Level  II  certificaiion  m  (he  functional  area  of  coniracung 
The  second  requirement  is  (he  attainment  of  a  warrant,  which  is  a  delegation  of  contract 
authoniy  usually  speci^d  in  dollar  thresholds,  per  FvJerul  AcifulxilHm  Regulation  {FAR) 
I  602-1  authority.  Unlike  commercial  contracting,  in  which  a  company  may  be  bound 
through  "apparent  authority,”  the  US  government  is  bound  only  by  an  individual  who  has 
attained  a  warrant  These  requirements  are  necessary  to  ensure  (he  respondents  have  the 
requisite  knowledge  and  experience  to  appropriately  address  the  questions  posed  m  the 
CMMM 

C.  L IM  IT  ATIONS/IM  PLICATIONS 

As  Edith  Sti^ey  and  Richard  Zeckhauser  state  in  their  bo<^  A  Primer  for  Potky 
AnaJyxii  (I97B),  “You  should  develop  a  healthy  skepticism  about  models,  and  become 
aware  of  their  limitations  A  good  way  to  start  is  by  making  sure  that  you  understand  all 
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ihe  assumptions  aboui  ihe  relationships  that  ihe  model  impltes  and  ihe  data  that  n  uses” 
(p  21 ).  The  limiieiions  of  the  models  used  tn  this  research  are  ihai  they  only  provide'  an 
evaluation  of  the  murunTy  level,  an  evaminaiion  of  ktwwledge  management  practices, 
and  an  identification  of  areas  in  which  training  or  additional  policies  could  be  applied  to 
improve  capabilities.  This  research  is  not  a  statistical  analysis  and  does  not  focus  on 
random  samples  of  a  large  population.  Lastly,  the  CMMM  cannot  provide  contract 
training  or  recommend  specific  policies  to  the  organi2aiion,  but  it  will  recommend  areas 
for  further  research. 

The  implications  from  the  application  of  the  CMMM  and  adapted  knowledge 
management  survey  may  be  extended  to  other  Air  Force  commands.  The  knowledge 
management  model  may  be  used  to  identiiy  the  organizations'  ability  to  learn  and  may 
prepare  these  organizations  for  larger  E>oD  strategic  plans  Further  systematic  use  of  the 
knowledge  management  model  will  help  prepare  organizations  to  comply  with  the  DoD 
Human  Capital  Strategic  Plan.  This  DoD  initiative  addresses  three  mam  areas  in  which 
the  DoD  must  meet  personnel  challenges:  atmtion,  individual  and  organizational  skills, 
and  the  human  capital  strategic  planning  process  (United  States.  Office  of  the  Under 
Secretary  of  Defense  for  Acquisition,  Technology,  and  Logistics,  2007). 

El.  SJCJMFICANCE  OF  STUDY 

Although  some  might  argue  this  next  pomi,  industry  best  practices  and  theories 
are  extremely  relevant  to  government  organizations— in  this  case,  the  OC-ALC.  As 
outsourcing  and  other  procurement-related  acitviiies  become  more  important,  contract 
management  develops  into  a  key  core  capability.  Having  a  competitive  advantage  in 
conu^i  management  allows  the  OC-ALC  to  gain  invaluable  skills  and  organizational 
routines.  However,  these  benefits  are  only  gained  because  the  OC-ALC  has  mature 
processes  and  procedures.  Competitive  advantages  are  maintained  only  through  constant 
self-evaluation  and  inirospeciion  In  these  turbulent  times,  a  compeiiiive  advantage  can 
also  help  organizations  (in  this  case.  Tinker  Air  Force  Base)  justify  their  existence  when 
being  considered  in  the  base  realignment  and  closure  process,  and  even  when  performing 
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A-76  studies.  The  A-76  srudies  [irimarily  focus  on  efficiency  and  whether  lo  outsource 
ihe  organization's  capabiliiies  ihai  cannot  be  performed  more  cheaply  with  the  organic 
resources  available. 

As  mentioned  above,  the  OC-ALC,  much  like  any  other  business,  needs  to 
continually  innovate  as  well  as  self-assess  to  improve  This  focus  helps  ensure  customer 
(e.g.,  warfighters,  DoD,  etc.)  satisfaction  by  improving  operational  availability, 
decreasing  response  times,  reducing  redundancies,  and  better  meeting  other  customer 
needs.  The  DC-ALC  is  an  established  organization  with  a  long  history  in  contract 
management;  however,  it  has  undergone  and  will  continue  to  go  through  significant 
transformation.  Motivation,  united  with  these  transformations  (i  e.,  reductions  m  force, 
force  shaping,  and  retirements),  creates  a  genuine  need  for  the  use  of  these  models. 

To  keep  itself  at  the  leading  edge  of  acquisition  and  sustainment  excellence,  the 
OC-ALC  has  put  into  practice  the  following  initiatives  (not  all  inclusive,  the  reason  for 
which  will  be  discussed  in  more  detail  in  Chapter  (1(): 

•  Employee  development  programs  (e.g..  Civilian  Tuition  Assistance 
Program  (CTAP),  Tinker  Opporruniiies  for  Professional  Service  (TOPS), 
and  Employee  Enhancement  Program  (EEP)) 

•  Tinker  Lean  Institute 

•  Purchasing  and  Supply-chain  Management 

The  OC-ALC  has  taken  the  steps  listed  above  to  improve  its  acquisition 
processes;  however,  conu^i  management  personnel  have  not  been  specifically  targeted 
for  a  focused  study.  This  subsequently  led  the  researchers  to  implement  the  CMMM  and 
Learning  Organizational  Assessment  The  information  received  through  these  models 
will  allow  the  OC-ALC  to  employ  training  and  policies,  or  if  necessary,  to  retract  training 
and  policy  guidelines  (Garreti  &  Rendon,  200S). 

This  study  is  outlined  in  Eve  chapters  Chapter  (  provides  an  overview  of  the 
research  on  this  topic.  Chapter  II  consists  of  a  review  of  literature  used  to  develop  the 
study  and  current  etfons  within  the  DoD  regarding  knowledge  and  contract  management 
Chapter  III  includes  background  information  on  Tinker  AFB,  Oklahoma,  as  well  as  the 
specific  organizations  and  personnel  that  participated  in  the  survey  and  how  the  Air 
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LogisDcs  Center  tnaienahzed.  Chapter  IV  pre&eni5  titvjing&  and  resuiia  of  the  study  as 
well  as  reconunendaibons  Chapter  V  provides  a  summary  and  suggestions  for  furiher 
research 

i.  SUMMARY 

This  chapter  discussed  the  purpose  of  the  study.  AFMC’s  background 
information,  AFMC’s  current  initiatives,  the  study’s  problem  statement,  conceptual 
framework,  research  questions,  the  nature  of  the  study,  the  limiiaiions,/implications  of  the 
study,  and  the  signilicance  of  the  study.  The  following  chapter  will  discuss  the  benefits 
derived  through  assessment,  marunty  models,  and  the  DoD  Human  Capital  Strategic 
Plan.  Chapter  II  will  also  provide  key  background  information  on  the  CMMM  and  the 
Learning  Organizational  Assessment 


II.  RLVILW  OK  m  KRAI  tRt 


A.  INTRODUCTION 

Fatleil  acquisiiion  atvj  contracting  actions  are  becoming  more  and  more  prevalent 
For  example,  the  Darleen  Druyun  and  the  Coast  Guard's  Deepwater  program  have 
become  poster  children  for  failed  government  oversight.  In  addition  to  the  media's 
highlight  of  the  above  examples,  the  Oovemment  Accountability  Office  ((lAOl  has 
classified  DoD  contract  management  as  a  “High  Risk”  area  since  1992  (GAO.  2W7) 

To  maintain  a  high-fidelity  contracting  environment,  an  organization  must 
develop  and  sustain  mature  contracting  processes  and  procedures;  however,  high  fidelity 
only  comes  with  an  organization’s  ability  to  transfer  knowledge  within  itself  By 
focusing  on  both  contracting  processes  and  the  transferring  of  knowledge,  the  DoD 
(specifically  the  USAF)  will  be  able  to  adeptly  do  more  with  fewer  personnel.  This 
chapter  will  discuss  both  the  researchers’  reasons  for  choosing  the  CMMM  and  the 
Learning  Organizational  Assessment  questionnaires  as  well  as  the  benefits  gained 
through  assessment.  It  will  also  provide  background  information  on  the  Human  Capita) 
Strategic  Plan,  other  matunty  models,  CMMM,  CMMAT,  and  the  Learning  Organization 
Assessment. 

B.  BENEFITS  DERIVED  THROUGH  ASSESSMENT 

The  Contract  management  (CMl  process  is  a  very  formalized  and  complex 
process  CM  requires  contracting  officers  to  not  only  interact  with  their  users,  but  also 
with  people  from  difTerent  functional  areas  (e.g.,  pilots,  engineers,  etc.).  The  DC-ALC's 
Directorate  of  Contracting  perpetuates  this  mentality  by  supporting  conu^iing  eftons  on 
the  various  aircrafl  (e.g.,  B-ls,  B-2s,  B-S2s),  cruise  missiles,  engines,  and  flight 
instruments,  to  name  a  few.  The  contract  management  leadership  at  the  OC-ALC  directs 
over  I  S,000  contracts  annually  at  a  value  of  $3.3  billion,  which  requires  the  installation  to 
interact  with  the  gamut  of  agencies  (Air  Force  Link,  2007).  These  contracting  actions 
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require  inieraction  with  aome  of  the  industry’s  largest  contractors,  like  Boeing  and 
Lockheed  Martin,  but  also  with  small,  distadvaniaged  businesses  (e.g.,  Nadve  American 
ownedl. 

CM  IS  performed  by  organizations  in  a  very  dynamic  world;  management  must 
adapt  to  new  policies,  procedures,  and  new  ways  of  doing  business.  In  other  words, 
businesses,  or  in  this  case,  the  OC-ALC,  must  continually  adapt  to  maintain  their 
competitiveness.  Contracting  can  be  likened  to  a  professional  athlete.  Professional 
athletes  are  only  good  because  of  countless  hours  of  practice.  In  order  for  these  athletes 
to  understand  their  progress  towards  their  goal,  they  must  assess  where  they  are. 

Organizations  follow  this  same  pattern  through  the  assessment  of  their  processes. 
Processes  provide  the  foundation  tor  every  business  and  ensure  its  success  as  an  entity  in 
the  form  of  a  competitive  advantage;  this  also  applies  to  DoD  organizations.  Through  the 
evaluation  of  processes,  an  organization  can  realize  and  create  a  sustainable  competitive 
advantage  through  corporate  strategy.  Development  of  a  sustainable  competitive 
advantage  hinges  on  the  presumption  that  activities,  in  this  case  processes,  and  superior 
performance  of  those  activities  can  generate  intangible  assets.  On  the  other  hand,  if  these 
activities  are  performed  poorly,  they  can  produce  liabilities  instead  of  assets.  This 
statement  is  especially  true  because  procurement  activities  (synonymous  with  DoD  CMl 
are  a  value-added  support  activity  in  the  value  chain.  Activities  performed  tn  these  areas 
can  help  organizations  create  a  sustainable  competitive  advantage.  This  is  illustrated 
further  in  Figure  1  below  (Porter,  19851. 
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Figure  ].  V«lue  Chain  Aaalyftift 
(From  Porter,  1985) 

The  con^quesces  of  a  DoD  or^3ioi2ation  losing  ns  competitive  advantage  can  be 
dire,  (fthis  were  to  happen,  the  unit's  mission  could  be  absorbed  by  another  unit  or,  in 
some  instances,  outsourced  to  a  coDlracu»'  through  as  0MB  CoTular  A-76  eOicieocy 
srudy,  commocly  called  on  A-76  study  >  For  example,  the  OC-ALC's  mission  could  be 
routed  lo  another  ALC  (e.g.,  Warner  Robins),  moved  to  AFMC  headquarters  at  Wrighi- 
PattersoD  Air  Force  Base.  Ohio,  or  even  moved  to  a  Navy  or  Army  logistics  center. 
However,  this  scenono  con  bo  avoided  through  constant  self-evaluation  and  proccsv 
improvemenL  DoD  organizations  use  various  inspeciions — such  as  unit  compliance 
inspections,  operauooal  readiness  inspections,  and  in  some  cases,  matunty  models— to 
help  insure  an  organization's  readiness  or  capabiUty.  These  inspections  and  models  are 
tools  that  help  aid  the  organizaiioo's  advancement  through  ihe  process-unprovemeol 
lifecycle  (Figure  2). 


I  ibM  OBJcd  b)*  iIk  Office  c(  sr^  Byd9ei  t  fnnoAj  of  ecff^pwg  ^wiveu 

pcrtoJe^MCJorcau  fcv  (wmbr  fuDcUm 


II 


Figure  2.  Project  Mooagemeot  Process  (mprovcnicni 


A  goo<j  example  of  constant  process  improvement  can  be  found  m  Wal-Mait,  Inc 
As  IS  commonly  known,  Wal-Mait's  strategy  ts  to  sell  its  products  at  the  lowest  possible 
price  to  Its  customer  base.  To  make  this  happen,  Wal-Mart  developed  an  innovative 
approach  of  opening  stores  at  locations  that  did  not  have  a  large  competitor,  only  “mom- 
and-pop’'  shops  This  strategy,  in  conjunction  with  its  hub-and-spoke  discnbuiion  system, 
created  a  unique  value  cham  that  Wal-Mart ’s  competitors  could  not  imitate  quickly.  This 
competitive  advantage  only  lasts  so  long  before  competitors  adapt  and  begin  to  usurp 
some  of  the  protlis  gained,  which  is  why  Wal-Mart  continually  strives  tor  improvement 
This  can  be  shown  both  through  its  constant  re-evaluation  of  iis  distribution  system  and 
Its  constant  incorporation  of  new  technology— for  example,  Radio  Frequency 
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ldeni)rM:aiion  (RFID) — to  keep  C43mpediive  ^  This  constani  evolutlona/y  process  allows 
Wal-Mait  10  conilnue  lo  enjoy  its  cost  advantage  over  its  competiiors,  thus  sustaining  a 
long-term  competitive  advantage. 

C.  MATURITY  MODELS 

As  staled  previously,  process  improvemeni  can  only  be  obtained  through  constant 
self-evaluation.  Industry  has  created  an  onslaught  of  maturiiy  models  to  help  us 
respective  organizations  or  business  units  grow  and  evolve  lo  maintain  their  competitive 
advantage  over  their  peers  (Porter,  I99B)  The  following  are  some  of  the  models  that  will 
be  explained  in  this  section'  Software  Engineering  Institute’s  Capability  Maturity  Model 
Integration  (SEI-CMMl),  Kerzner  Project  Management  Maturity  Model  (PMMM),  the 
People  Capability  Matunty  Model,  and  the  Berkley  Project  Management  Process 
Maturity  (PM^)  Mode!  (Garret  &  Rendon,  2005).  Most  of  these  models  evaluate 
acquisition  (project)  management;  but,  most  professionals  will  tell  you  that  acquisition 
management  and  CM  are  closely  related. 

The  Software  Engineering  Institute's  Capability  Matunty  Model  Integration  (SEI- 
CMMI)  was  developed  by  Carnegie  Mellon  University,  which  is  a  Federally  Funded 
Research  and  Development  Center  (FFRDC).^  The  model  is  described  as  unilying 
diflerent  functional  areas  (e.g.,  project  management,  CM,  engineering)  so  that  processes 
can  become  more  robust  and  mature.  This  model  can  be  applied  at  all  levels  of  business 
to  include  projects,  divisions,  and  even  an  organization  The  model  scores  organizations 
according  to  five  levels,  which  span  horn  level  one  (Initial  Level),  least  mature,  to  level 
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five  (OpCknu2ing  Level),  which  is  ihe  most  tnaiure.  The  model  hjs  been  applied  la 
several  differeni  places,  mcluding:  Europe,  Asia,  Ausiralia,  South  America  and  Aftica 
(Paulk,  1995). 

Dr.  Harold  Keraner's  Project  Management  Maiuriiy  Model  (PMMM)  was  created 
through  Kerzner's  experience  as  a  professor  in  systems  managemeni  at  Baldwin- Wallace 
College.  The  PMMM  includes  five  levels  that  represent  varying  levels  of  project- 
management  maturity  The  five  levels  consist  of:  common  language,  common  processes, 
singular  methodology,  benchmarking,  and  continuous  improvement.  The  PMMM 
provides  the  user  a  comprehensive  diagnostic  instruction  that  helps  to  reveal  an 
organization's  gap  between  where  it  is  now  and  the  next  higher  maturity  level  The 
model's  questions  reference  the  Prog'um  Mantjgvmvni  B<hJy  oj  Knowledge  Guide,  which 
provides  best  practices  for  program  managers  and  explains  how  to  move  up  the 
improvement  curve  (Kerzner,  200) ). 

Another  model  developed  by  the  Software  Engineering  Institute  (SET),  through 
the  sponsorship  of  the  DoD,  is  The  People  Capability  Maturity  Model  (P-CMM)  SE) 
has  developed  a  second  version  of  the  P-CMM,  which  is  believed  to  have  fixed  some  of 
the  issues  that  arose  with  the  first  variant,  released  in  199S.  The  model  is  a  framework 
that  assesses  an  organization’s  ability  to  continually  develop  the  most  important  asset  of  a 
business — its  people.  The  P-C'MM  book,  Th«  People  CapabilUy  Mafurity  hditJef 
Guidelines  for  Improving  the  Workjorce  states  that  the  model  will  help  organizations 
characierize  the  marunty  of  their  workforce,  set  pnorities  for  immediate  action,  iniegraie 
workforce  development  with  process  improvement,  and  become  an  employer  of  choice 
(Curtis,  lletley  &  Miller,  2(X)I)  It  accomplishes  this  using  the  components  found  in 
Figure  3  below,  which  moves  the  organization  along  through  the  P-CMM' s  structure  and 
Five  marunty  levels. 
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ricure  3.  Tbe  People  Ctpabillty  Maturity  Model:  Culdclloes  for  lioprovlnc 

ibe  Workforce 

iFrom  Helley  &  MiDer.  2001 ) 


The  Begley  Project  Monagemeni  Process  Marunry  (PM^)  Model  was  developed 
by  Professors  Young  Noon  Kwak  (George  Washington  University)  and  C.  William  fbbs 
(Berkley  University).  The  model  modifies  intbrmation  from  the  Program  Manag^eftf 
B>h/v  of  Knowledfie  [PMBOK)  into  nine  PM  knowledge  areas  and  five  PM  processes 
(Figure  4  below).  The  breakdown  assists  the  organization  by  detailing  the  maturity  of  the 
organization's  PM  processes.  After  assessing  the  organization,  the  model  encourages  the 
organization  to  achieve  more  refined  PM  maturity,  which  is  accomplished  incrementally 
(lbbs&  Kwak.  1997). 
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Figure  4.  Project  Maoagcmeoi  Process  Moiurliy  (PM^)  Model 
(From  Ibbs  &  Kwak,  1997,  pp.  \-S) 


Each  of  the  models  listed  above  has  its  own  imrque  focus,  bui  each  is  composed 
of  the  same,  common  characteristics  All  of  the  models  act  as  tools,  or  yardsticks,  that 
provide  the  organiaation  an  honest  measurement  of  where  it  is  now  and  what  It  needs  to 
get  to  the  next  stage  of  maturity  The  maturity  of  an  organization  is  assessed  by  each 
model's  incremental  approach  Also  common  among  the  models  is  that  they  have  been 
applied  to  diftereni  organizations  within  the  DoD.  For  example,  the  P-CMM  was 
sponsored  and  used  by  the  Army  OfTice  of  the  Director  of  (ntbrmation  Systems  for 
Command,  Control,  Communications,  and  Computers,  as  well  as  the  Office  of  the 
Assistant  Secretary  of  Defense  for  Command,  Control,  Communication,  and  Intelligence. 

Although  some  of  the  models  above  have  been  used  in  a  DoD  setting,  the  Office 
of  Personnel  Management  (0PM)  has  strategically  created  its  own  overarching  model  to 
identify  and  alleviate  potential  knowledge  gaps.  This  initiative,  called  the  Human 
Capita!  Plan  was  created  through  the  teaming  of  0PM  and  the  Under 

Secretary  for  Defense  Acquisition,  Technology,  and  Logistics  (USD(AT&L)). 
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D.  DOD  HVMAS  CAPITAL  STRA  TEGIC  PL4S  (ilCSPf 

Ai  the  US  l2bor  force  ages,  there  will  be  a  si^ficaat  change  m  the  workforce  [n 
this  change  there  ore  many  trends;  however,  there  ore  a  few  ihoi  ore  more  pertioeni  to  the 
DoD  than  others.  These  are  listed  below. 

•  TraaslbrreatioD  of  mission  from  new  and  evolving  osymmeincol  ibreais  to 
protracted  conflicts  around  the  world 

•  New  ebaUeoges  associated  with  hmneland  defense 

•  Poieniiol  loss  of  retirement-eligible  personoel  (Table  2) 

•  Greater  competition  for  talent  with  the  private  sector 

•  Evolution  of  the  DoD  Total  Force  Construct  to  strategically  manage  contractor 
support  (United  Suites.  Oflioe  of  the  Under  Secretary  of  Defense  for  Acquisition. 
Technology,  and  Logistics,  2007) 


AftlWaikhrce  bf  Scnmli 


W«Uo 


Cei6faiM  X 


irui 


P«SJ 


Table  2.  AT&L  VVurkfurce  bv  Generaiiun 
(From  Amour,  2002) 


These  main  issues  are  wbai  led  0PM  and  ihe  Under  Secretary  of  Defease  for 
Acquisition.  Technology,  and  Logistics  (USD  (AT&L))  to  develop  the  Human  Cupiiol 
Slraie^c  Pfun  The  HCSP,  which  is  now  on  version  three,  is  nbgned  with  the  Pr^ldvnJ  s 
Management  Ajfendu,  the  Naitunal  Defense  Slrole^\  Haliunaf  Military  Sfraie^^i',  the 
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QuiuliVfmiai  Defence  Revi^**-,  ihe  DoD  Civilian  HCSP.  and  i8  alS43  accounuble  lo  ihe 
goals  in  itK  llimian  Capiia)  Assessment  and  Accountabiliry  Framework  (developed  by 
ihe  OfTice  of  Personnel  Managemeni  (0PM)).  The  HCSP  Is  a  very  large  and  broad 
tniiiaiive  that  encompasses  many  organizaiions,  funciional  areas,  and  activities  that  are 
focused  on  mainiaming  a  capable  workforce  ihai  supports  the  warfighier  The  USD 
(AT&L)  HCSP  has  seven  overarching  objectives  to  help  miiigate  some  of  ihe  negative 
trends  in  the  US  workforce. 

1  High-perlbrming,  Agile,  and  Ethical  Workforce 

2  Strategic  and  Tactical  Acquisition  Excellence 

3  Focused  Technology  lo  Meet  WarTighting  Needs 

4  Cost-effective  Joint  Logistics  Support  tor  the  Warfighter 

5  Reliable  and  Cost-effective  Industrial  Capabilities  Sufftcieni  to  Meet 
Strategic  Objectives 

6  Improved  Governance  and  Decision  Process 

7  Capable,  Efficient,  COst-efTeciive  Installations 

Each  functional  area  (e.g.,  program  management)  is  requued  to  develop  a 
capability  model  to  saiis^  the  above  goals  Due  to  the  nature  of  this  paper,  only  the 
Contracting  Competency  Model  developed  by  the  Defense  Procurement  and  Acquisition 
Policy  (DPAP)  office,  m  conjunction  with  the  OPM's  Center  for  Talent  Services,  will  be 
discussed 

The  cornerstone  to  the  DuD  ALifuishion  and  Technaloj^-  Hnmtn  Capital  Slrule^c 
Plan  IS  the  development  of  competency  models  for  the  functional  areas  of 
Indusirial/Conu^t  Property  Managemeni,  Contracting,  and  Purchasing,  or  what  the 
DPAP  calls  the  "Coniractmg  Community.’'  This  model,  known  as  the  Conu^ting 
Competency  Model,  is  comprised  of  multiple  efforts  which  are:  lo  define  the 
competencies  required  to  meet  the  mission,  assess  the  workforce  to  identify  current  and 
future  gaps,  adjust  personnel  strategies  (e.g.,  recruitment  and  retention  efforts)  to 
eliminate  gaps,  and  create  opportunities  for  training  and  development.  This  is 
accomplished  through  the  analysis  of  individual  competencies  that  will  be  assessed  by 
supervisors  and  senior  leadership.  The  Electronic  Systems  Center,  Hanscom  Air  Force 
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MA,  is  a  lest  base  for  ihe  DPAP’s  model,  and  the  OC-ALC  wilt  also  be  tested  next 
year.  The  DPAP  model  may  be  utilized  ai  the  command,  functional,  base,  or  even  at  the 
squadron  level. 

The  Coniraciing  Competency  Model  uses  an  assessment  made  of  two  online 
questionnaires  that  are  specifically  tailored  to  reflect  competencies  needed  tor  employees 
at  the  location  to  perform  their  dunes  (eg.  systems  acquisition),  general  competencies 
(e.g.,  reasoning),  and  also  technical  competencies  that  are  pertinent  to  the  specific  senes 
of  individuals  (e.g.,  nsk  management).  The  questionnaire  requires  each  incumbent 
member  to  assess  his/her  personal  proficiency  level  in  each  of  the  competencies;  it  also 
includes  a  section  on  recruitment,  training  and  development,  and  retention  of  the 
organization.  The  supervisors  will  then  also  assess  the  proficiency  of  the  employees  they 
manage  at  the  group  level  on  a  set  of  strategic  core  organizaiion-wide  competencies,  as 
well  as  on  the  minimum  level  required  and  esiimaied  aoriiion  at  each  level.  Each  of  the 
questionnaires  requires  around  30  minutes  lo  complete  and  is  confidential  in  nature. 

After  the  completion  of  the  questionnaires,  0PM ’s  Center  for  Talent  Services 
analyzed  the  data.  The  results  showed  that  ESC’s  civilian  contracting  specialists,  1 102 
series  in  the  Civil  Service  system,  were  going  to  have  significant  future  competency  gaps 
These  gaps  are  formed  between  where  the  employees  assess  themselves  at  now  and 
where  they  will  need  to  be  in  the  future  (established  by  the  supervisor  and  management) 
Some  of  the  more  prominent  areas  m  which  gaps  were  identified  were  in  systems 
acquisition,  creative  thinking,  planning  and  evaluation,  and  in  problem  solving  (Figure 
6)  The  model  then  goes  on  to  suggest  different  ways  of  reducing  the  gaps  through 
training,  recruiting  policies,  etc. 


19 


Aggregate  Future  Competency  Gaps 
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Fissure  5.  Project  Rc&ulu  &  Recoomicndoiioos  BricflDg  Cborls,  Slide  34 
(Frtxn  Ccnicr  for  Talent  Servu;es,  OPM,  2U07,  Februaj>  2  ( j 

The  Human  Cuptfal  Siruie^c  Plan  u  a  very  broad  and  overarching  iohiauve  that 
encumpa«iaes  maoy  Jiftereni  artfOK.  The  main  objective  of  this  policy  l«  to  help  the  DoD 
decrease  the  impact  of  the  retiremeoi  of  the  baby  boom  yeserolion  through  training 
recniitiny.  eic.  While  the  plan  is  a  work  in  progress,  many  changes  are  evpecied  lu  be 
nude  before  it  is  fully  implemented  The  focal  point  of  the  Cootract  Management 
Meturity  Model  (CMMM)  is  discu&sed  below  (Cnrreii  &  Rendon,  200S). 

E .  CM  MM  BACKGROUND  JN  FORMATION 

This  research  usm  the  Contract  Management  Maturity  Model  (CMMM)  and  the 
asiociaied  Contnici  Managemest  Maturity  Assessment  Too)  (CMMAT)  lu  evaluate  the 
OC'ALC's  coBiract  nuoagenseni  procesaes  and  ^cedures.  Tbe  CMMM  soil  CMMAT 
were  selected  because  of  their  application  of  cniical  CM  processes  and  fundamental 
ability  to  improve  CM  functions  within  an  organization  through  the  analysis  of 
organizational  competencies.  This  naodel  ii  especially  relevant  to  tbe  large  coniraciing 
squadron  located  at  the  OC-ALC  that  provides  support  to  key  Air  Force  assets  (e.g.,  B- 
52s). 
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The  CMMM  defines  macuhiy  as  '‘full  development  of  orgamz^iional  capabihiies 
ihai  can  consisienily  produce  desired  outputs”  (Garret  &  Rendon,  200S,  p.  67).  The 
purpose  of  the  model  is  lo  help  any  procuremeni  organization,  DoD  or  commercial 
business,  to  ideno^  potential  areas  for  continual  process  improvement.  The  CMMM 
breaks  procurement  activities  into  two  main  areas'  buyer  and  seller  activities.  The 
CMMAT  then  breaks  down  each  of  these  view-points  (buyer  or  seller)  into  six  sections 
The  Seller's  Perspective  is  broken  down  into  presales  aciiviiies,  bid'no-bid  decision¬ 
making,  bid/proposal  preparation,  contract  negotiation  and  formation,  contract 
admimstrauon,  and  contract  closeout.  Doe  to  the  DC-ALC's  mission,  the  buyer's  process 


areas  (Table  3)  were  analyzed 


Kry  Process  .\rea 

UcfinicioQ 

Procurement  Plaouing 

'Die  process  of  identifying  Much  biBiness  needs  can  be  basi  met  by 
ptocunogproJiKis  or  services  outside  the  orgaomtion.  Dus  process 
involvos  detemuniiig  v^hetber  to  procure,  bo«  to  procure,  Mhai  u  procure, 
sftd  Men  lo  procure. 

SolKiuiun  PlaoDing 

Die  process  ofprepanng  ihe  documents  needed  to  support  the  solicitaiion 
Dis  process  involves  documeoting  prolan  reQiurements  and  idcniifying 
posenoal  sources 

Solicitaiioii 

'Die  process  of  obtaining  informasoo  (bids  and  proposals)  bom 
hiv.  rte,  n»r 

SouKe  Seicciiori 

'Die  process  of  receiving  bids  or  proposals  and  applying  evaluation  cnicria 

10  selects  provider 

Comract  Adnuftisvaiiori 

Hie  pfoceisofcdsunDg  ihjt  etch  pury^s  pertomjf^c  rT>eet&  conmctiti 

Comract  Closeout 

De  process  of  vending  cMi  all  sJitnniMraiivc  mattess  are  concluded  on  a 
contract  thai  IS  otherwise  pltysicaJly  complete.  Dus  mv^ves  completing 
wl  twiKiAo  «fii  mnw 

Table  3.  Buyer's  Perspective  Key  Process  Area  and  Definition 
(From  (iarreit  &  Rendon,  2005) 


The  CMMAT  questionnaire  is  compnsed  often  questions  tor  each  of  the  relevant 
sections  described  above  and  is  evaluated  using  a  Liken  scale  Each  employee  who  is 
warranted  and  DAH'IA  Level  11  certi^d  in  CM  scores  each  question  using  a  scale  from 
one  (Never)  to  five  (Always);  but  the  survey  also  includes  an  option  for  Don’t  Know 
(scored  as  a  zero).  'The  employee's  responses  are  totaled  for  each  question  and  then 
divided  by  the  number  of  participants  to  obtain  an  average  score  per  question  These 
results  are  then  totaled.  Aflerwards,  the  scores  are  compared  to  the  conversion  table  to 
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determine  the  meruriiy  level  the  organiziiion  has  echteved  in  that  [unicular  process  area 
A  score  of  0-20  dictates  a  maturity  level  of  "Ad-Hoc’';  21-30  correlates  to  “Basic”;  31-40 
shows  a  tnaiuriiy  of  “Structured”;  41 -4S  relates  to  an  “Integrated’'  motunty  level;  46-50 
correlates  to  an  ''Optlmued"  matunty  level  (highest).  The  definition  of  each  of  the 
respective  maturity  levels  can  be  tbund  below  in  Figure  t>. 
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Contract  Management  Maturity  Model  (CMMM") — fidrratlve 
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mbAToo  to  4iiDfOT0  Ch0  contract  nt^bd  amort  I 
nandac^  and  ddctantoAtoifion. 

9  nrecLTontant  p^ceaas  staanuinotg  rtrtmvai  aravmpi^ 
manttf  as  parrot  am  preegs  irTtpr^‘romanT  preyaw 


Figu  re  6.  CMM  M  Moturi  lT*lev  ci  Denoliioos 
(From  Gorreo  &  RLiidoo,  200S,  reprinifd  wiib  authors'  perreiision) 
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TtK  book  Contt-acl  Manuf^etfenl  Ot};ani2aui>nal  A.Mtexxmen!  T<hiK\  (Oarren  & 
Retvlon,  200S),  which  conuins  the  CMMM  and  other  que&uonnaires,  descnbe&  one 
parhcular  applicoiion  of  the  CMMM.  The  Air  Force  Space  and  Missile  Center's  (SMC) 
Direcioraie  of  Contracting  (located  at  Los  Angeles  Air  Force  Base,  Californio)  used  ihe 
CMMM  and  CMMAT  to  osess  iis  CM  process  fflohinry  m  2003.  The  SMC's 
Directorate  of  Contracting  oversees  all  CM-relaied  activiiies  within  its  seven  different 
program  offices.  The  seven  program  offices  are:  Space-based  Radar  (SBR),  Defense 
Support  Program  (DSP),  Evolved  Expendable  Launch  Vehicle  (EELV),  Global 
Positioning  System  (GPS).  Space  Tracking  and  Surveillance  System  (STSS),  Launch 
Program  (LP),  and  the  Space-based  Infrared  System  (SBIRS). 

The  CMMM  uses  a  '^mall,  purposive  sample”  for  its  selection  of  respondents, 
vice  using  a  staiisticaJ-based  approach  using  random  samples  (Garret  &  Rendon,  200S,  p 
76)  The  primary  reason  for  using  a  purposive  sample,  vice  large  random  sample  as  used 
in  statistical  analysis,  is  due  to  the  nature  in  which  contracting  personnel  are  developed 
The  model  uses  inputs  from  individuals  who  have  “grown  up”  in  the  OC-ALC  and  have  a 
solid  knowledge  of  the  center's  CM  processes.  Had  this  method  not  been  used,  the 
model  would  include  data  from  new  accessions  that,  more  than  likely,  do  not  have  a 
fundamental  understanding  of  the  organization's  process.  This  would,  consei^uenily, 
result  in  skewed  data  which  would  not  provide  a  meanmgful  assessment.  Due  to  this 
bet.  the  number  of  people  selected  is  not  considered  to  be  of  significant  value 
Participants  that  were  selected  were  chosen  based  on  their  responsibilities  to  maintain 
proficiency  in  CM  processes  and  procedures.  As  mentioned  previously,  each  participant 
had  to  meet  two  requirements.  First,  the  individual  must  have  been  DAWIA  Level  II 
cemtied  in  CM.  Secondly,  the  individual  must  also  have  an  active  warrant.  The  FAR 
I  602-1  (2005)  defines  this  auihonty  this  way;  “Contracting  officers  have  authority  to 
enter  into,  administer,  or  terminate  contracts  and  make  related  determinations  and 
findings.  Contracting  officers  may  bind  the  Crovemment  only  to  the  extent  of  the 
authority  delegated  to  them.” 

The  data  was  collected  and  analyzed  It  resulted  in  the  fblfowmg;  rated  at 
“Structured”  in  the  process  areas  of  procurement  planning,  solicitation  planning. 
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9olk;)UiiDn,  iU>d  conifaci  odmtnisifaiion.  Tbe  SMC  was  rawJ  ai  “Intjyrfifi'J*’  sn  Murce 
seltfktiun  and  "Ad-Hoc'*  in  coniract  closeoui.  The  grtiphical  representation  beluw  (Figure 
S)  shows  the  re^uits  of  each  of  the  individual  program  offices  widua  the  SMC.  The 
directoraie-wide  assessment  was  based  on  ihe  lowest  assessed  matunty  level  on  die  idea 
thai  on  organi2aiion  is  only  as  strung  as  its  weakest  link. 


Figure  7.  CMMM  Results  from  SMC  Study 
(From  Gairea  A  Rendon,  2005,  p.  82) 


The  SMC  can  use  the  above  rtsuli^  as  a  roadmap  to  improve  us  CM  processes 
and  procedures.  For  uisiance^  the  directorate  should  focus  oo  improving  the  four  key 
process  areas  rated  at  ''Strocrured"  to  the  next  maturity  level  of ''Integrated."  This  can  be 
achieved  by  providing  specific,  focused  process-emprovemeot  efTons  aimed  at  these  areas 
to  uuegrate  these  key  process  areas  with  other  core  processes  (e.g.,  cost  control,  schedule 
nunogemenf,  etc.)  (Oarren  A  Randan,  2005).  Another  great  beneHtoftha  CMMM  is  tbe 
SMC's  ability  to  leverage  ns  knowledge  from  one  ^gram  office  to  another.  For 
example,  LP,  who  was  raied  at  the  "Optimized”  level  in  contmci  odministratioo,  might 
shore  some  of  its  best  prucuces  with  the  SBR  office,  who  scored  ui  (he  "Structured"  level 
m  the  same  process  area. 


25 


F. 


BACKGROUND  INFORMATION  ON  KNOWLEDGE  MANAGEMENT 


This  research  uses  ihe  Learning  Organaaiion  Assessment  and  related  Learning 
Organization  Assessment  Matrix  adapted  from  Peter  Kline  and  Bernard  Saunders'  book, 
Ten  Steps  to  a  Lcvmtiig  Or^nhation  (1993).  The  assessment  and  matrix  will  evaluate 
the  OC-ALC  contract  management  organization’s  learning  organizational  characteristics 
and  emphasize  where  the  organization  needs  to  begin  to  lully  realize  the  benefits  of  a 
learmng  organization.  This  tool  was  selected  to  for  two  reasons:  first,  to  establish  the 
OC-ALC’s  learning  characteristics,  and  second,  to  >ind  out  if  there  are  any  correlations 
between  the  characteristics  and  the  management  of  the  OC-ALC’s  contracting  processes 
and  procedures.  Additionally,  this  assessment  gives  CM  leadership  an  indication  of 
whether  more  needs  to  be  done  to  improve  the  culture  of  its  workforce,  which  is 
especially  cntKal  with  the  rate  of  change  in  today's  business  environment. 

In  Ten  Stepx  /o  u  Learning  Orgitnizafton  (Kline  &  Saunders,  1993),  the  authors 
discuss  ways  to  improve  an  organization's  ability  to  be  more  flexible  in  adapting  to 
change  and  how  to  process  new  information.  The  Ten  Steps  are' 

1  Assess  your  learning  culture. 

2  Promote  the  positive. 

3  Make  the  workplace  safe  tor  dunking. 

4  Reward  risk-iaking. 

5  Help  people  become  resources  for  each  other. 

6  Put  learning  power  lo  work. 

7  Map  out  Che  vision. 

R  Bring  die  vision  to  life. 

9  Connect  the  systems. 

1 0  Get  Che  show  on  die  road.  ( 1 993 ,  Table  of  Contents) 

The  Learning  Organization  Assessment  is  comprised  of  36  questions  with  five 
possible  options  for  the  respondent  1  -  'Tiot  at  alt,”  2  -  “to  a  slight  extent, "  3  «  "to  a 
moderate  extent.”  4  -  To  a  great  extent,"  5  -  "to  a  very  great  extent"  After  die 
assessment  is  completed,  one  can  add  up  all  36  responses  and  divide  by  36,  the  number  of 
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suiemenu.  This  niunber  provides  an  average  (on  a  scale  of  1-5)  ot'respondenis'  beliefs 
regarding  ihe  characienstics  their  organizaiton  possesses. 

While  this  approach  provides  a  good  overall  impression  of  an  organization's 
learning  ability,  a  more  detailed  analysis  can  be  provided  by  utilizing  the  Learning 
Organization  Assessmeni  Matrix,  which  is  provided  below  (Table  4)  This  tool  shows 
which  of  the  Ten  Steps  applies  to  ihe  issues  raised  by  each  siaiemeni.  and  where  the 
reader  can  find  information  relevant  to  those  issues.  The  results  suggest  where  an 
organization  ts  strong  or  weak  and  can  be  used  as  a  yardstick  for  measuring  changes  over 
time.  Typically,  an  organization  believes  it  is  the  best  ai  what  it  does.  Management  oflen 
does  not  realize  a  simple  tool  like  this  can  provide  keen  insight  and  easy  remedies  to 
improve  its  culture.  This  evaluation  is  ever  more  important  as  the  Air  Force  downsizes 
Its  force  and  faces  numerous  civilian  retirements. 
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Enler  Assassireni  Rating  for  Each  heir 


ASSESSMENT  ITEMS 

I  (heirimnda 
i  Paopie  iMtn  from  nvnaftes 
3  Aaopie  9«a  Mtierweya 
d  Otlletam  Miaws  encouragM 
i  Eip«tinieniai)on  anci>jragM 
€  MtsfaKM  are  opponunities 
7  Willing  to  try  new  ways 
B  MenegemeM  takes  '^•s 
d  Wort  irfe  improung 
10  Learn  trom  eecn  cenet 

II  Sttixtutea  leu  learning 

12  Learn  Bcroes  eH  levels 

13  Awareness  Deyona  specsatry 
Id  noser's  teamed  seasons 
13  Oosoiere  p radices  repi a ceo 
10  Improve  men  I  expedsd 
17  Emptoyees  training  erpedsd 
IB  Ai  gel  reievartt  training 

19  CrosS'functonai  learning 

20  MiMie  managers  Lay  role 

21  Learn  trom  uneipecseo 

22  Eagerness  to  irrerove 
*23  Systems  are  tlenDia 
2d  reoto-enoading 

23  Stress  is  martagaapie 

26  Improvemen  not  just  talk 

27  Training  may  rot  ■  iear*vtg 
le  Learners  8eit<irectfrJ 

29  MOdie  managers  prepared 

30  Leamng  styles  recognizee 

31  Learning  ortterences  respedeo 

32  Time  tor  retlecBon _ 

33  Resource  tor  learttg _ 

3d  Teams  rewaroeo _ 

33  Martagers  coca  >wth  enange 
36  Statl  enapieo  to  improve _ 

Total  Overall  Sears _ 

DlviOe  Scare  syrheaa  numbers 

fteeuta  Aversfle _ 

Adaptation  of  Learning  Organization  Assessment  Malrlx 
(From  Kline  &  Saunders,  1993) 


Table  4 


28 


As  meniioned  above,  one  of  ihe  many  benetici  of  this  asses^meni  is  that  it  allows 
an  organization  lo  identify  areas  in  which  it  is  strong,  and  conversely,  where  ii  needa  to 
improve.  Once  a  weak  area  is  identified,  management  can  identify  that  Step  in  the  book; 
Klme  and  Saunders  provide  specific  drills  or  guidance  to  help  improve  this  area.  For 
example,  after  completing  the  assessment  for  his  organizaiiorw  an  individual  finds  that  the 
score  in  Step  3  (Making  the  Workplace  Safe  for  Thinking)  is  a  little  low  Me  could  go 
back  to  the  Ten  Steps  far  a  Leaminfi  Or^anizatio"  under  Step  3  and  discover  Kline  and 
Saunders  have  three  best  practices  to  promote  a  safe  working  place:  an  agreed-upon 
structure,  nurrunng,  and  minimal  critical  specification.  In  other  words,  not  on(y  does  the 
a.sseesment  provide  a  snapshot  of  how  the  organization  is  doing,  but  supplies  specific 
steps  for  improving  that  low  score  as  well. 

The  Learning  Organization  Assessment  does  not  have  any  rei^uirements  for 
participation,  unlike  the  CUMM,  which  requires  respondents  to  be  warranted  and 
DAWIA  Level  11  certified  in  CM  However,  due  to  the  nature  of  this  research,  individuals 
with  less  experience  were  targeted  in  an  etlbrt  to  see  how  much  training  and  information 
IS  getting  down  to  the  lowest  level  The  individuals  at  these  levels  will  play  a  major  pan 
of  the  force  transformation  process  once  retirement-eligible  workers  beginto  retire. 

C.  SUMMARY 

This  chapter  discussed  the  reasons  for  choosing  the  CMMM  and  knowledge 
management  questionnaires  and  the  benefits  of  such  assessments.  It  also  provided 
background  information  on  the  HCSP.  other  maturity  models,  CMMM,  CMMAT,  and 
the  knowledge  management  questionnaire.  Chapter  III  will  convey  the  particulars  of  the 
OC-ALC  study  to  include  relevant  background  on  Tinker  AFB  and  the  DC-ALC,  why  it 
was  chosen  for  this  research,  and  the  center’s  current  acquisition  excellence  initiatives. 
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1 1  [ .  OKL  A  HOM  A  ClI  V  Al  R  LOGlS  1 1 CS  C  EN  I  E  R  (OC-A  LC> 


A.  INTRODUCTION 

To  provide  (he  Air  Force's  wartighcer  wiih  ihe  best  equipment,  (he  USAF  must 
ensure  i(  has  mature  processes  and  procedures.  Toward  (his  end.  Tinker  APB's  OC-ALC 
was  asked  (o  take  part  m  (he  research  of  this  project.  This  section  will  provide  a 
background  on  (he  DC-ALC,  why  i(  was  chosen,  and  some  of  the  current  tni(ia(ives  a(  the 
OC-ALC. 


B,  BACKO  ROUND 

The  mission  of  (he  Air  Force  is  to  deliver  sovereign  options  for  the  defense  of  the 
United  States  of  America  and  its  global  mteresis — (o  By  and  lighi  in  Air.  Space,  and 
Cyberspace  To  achieve  (his  mission,  the  AF  uses  its  six  distinctive  capabilities;  Air  and 
Space  Superiority,  Global  Attack,  Rapid  Global  Mobility,  Precision  Engagement, 
Information  Superiority,  and  Agile  Combat  Support  (Air  Force  Link.  20071.  Major 
Commands  (MAJCOMs)  carry  out  these  capabilities  based  on  their  inherent  functions  or 
attributes  (Table  5).  The  Air  Force  Material  Command  (AFMC)  MAJCOM  is  (he  focus 
ofthis  paper 
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MAJCOM 


Misstot) 


AJr  Conbsi  CAmiuand 
(ACO 

ACC  ir  die  prunar^'  force  provider  of  coitibai  airpovver  to  ArticiKa'r 
warfighungcocnmaodr  Tosuppon  ^ofial  unplerticiKaiioii  oroaiMtiaJ 
aBcurirystraicsy,  ACC  operates  fighicr,  timber,  rccormairsancc, 
banle'tittDagemeni  and  elecTTonic-combat  aiicraA  liabo  proMder 
command,  conirol,  comnuoKaiionr  and  unelligciKe  rynems,  aod 
coaducts  elobal  infonnaiion  ooctatiotu 

AJr  Efiutailoa  aid  TrftJnUg 
Coiaraand  lAETC) 

AETC,  widi  bcadquarterr  at  Randolph  An  Force  Base  near  San 
Antonio,  Texas,  provides  basic  railiiary  training,  loitial  and  advaoced 
taclinical  training,  flyiog  trajDing.  andprofasaional  military  and 
degrce>gTaniing  profnsiooal  education  AETC*s  r^c  makes  it  ibe  Jim 
command  to  touch  die  life  of  almost  even  AirForce  member 

Air  MoMlln  ConinaAd 
iAMCl 

Deliver  maximum  «*arfighting  and  burtianiiarian  effects  tor  America 
itiroutfh  rapid  and  precirc  elobal  air  mobilitv. 

AJr  Force  Space  Ceramaad 
(AFSPC) 

itic  Ufi)M  States  through  the  control  and  cxploiiaooo  of 

Air  Force  Special  OpcraiH>o« 
ConiraaiMl  (APSOC) 

Amenca'a  rpccialircd  air  pover  a  step  ahead  in  a  chaoging  world, 
delivenog  Special  Operations  posver  anytime,  aoywtiere  AFSOC 
provides  Air  Force  special  operations  forces  for  suorldwide 
deployment  and  asifinmcnt  to  regional  urufied  conunarn^ 

LS  Air  Forcer  Itt  Eiirape 
<USAP£) 

At  Ibe  air  com  poo  ent  for  US  European  Command,  USAFE  directs  air 
operations  in  a  theater  spanning  iDreecooiincnis,  covering  more  than 

20  million  square  miles,  cootaioing  91  counines  and  possessing  one* 
fourth  of  Ibe  svorld's  populaiion  and  about  ooe>ihird  of  the  world's 
Gross  DomcsQc  Product 

Pacitk  Air  Forcer  (PACAP) 

Prov  ide  reUy  air  and  space  power  to  promote  US  idicresu  in  the 
Asia-Pacific  region  during  peacetime,  through  crisis  and  in  war 

AJr  Force  Malarial 

CooiraaiMl  (APMC) 

APMC  dalivers  war>winning  expeditionary  capabilities  to  the 
warfighter  through  devdopmeot  and  transioon  of  tachm^ogy, 
professional  ^uisuion  management  exacting  test  and  evsiuaiioii, 
aod  world-class  sustainmeot  of  all  Air  Force  weapon  sysicros  Prom 
cradle -10 'grave,  APMC  provides  the  svorit  force  and  infrastructure 
necessary  to  ensue  the  Unitad  States  remains  the  world's  most 
respocied  Air  and  Space  Force 
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Unhke  the  re«t  of  the  Air  Force,  most  AFMC  [tersonne!  are  civilians  (S6%)  or 
coniraciors  C26%),  many  of  whom  have  specialized  lechmcal  skills.  As  technology 
changes,  new  weapons  are  developed,  and  as  banlefieids’  operating  requirements  change, 
so  do  the  AFMC’ s  personnel  re^utremenis  (Vemez,  20071. 

The  AFMC  has  nearly  100,000  personnel  m  differeni  organizaiions  or  business 
units,  such  as  product  centers,  laboratories,  and  test  and  evaluation  centers.  The  AFMC's 
product  centers  are  the  Aeronautical  Systems  Center  (ASCI  located  at  Wnghi  Patterson 
AFB,  OH  (which  includes  the  headquarters  for  AFMC),  the  Elecironic  Systems  Center 
(ESC)  at  Hansom  AFB.  MA,  and  the  Air  Armament  Center  (AAC)  at  Eglin  AFB,  FL 
There  are  many  test  and  evaluation  centers  within  the  AFMC,  but  the  largest  test  and 
evaluation  center  is  Air  Force  Operational  Test  and  Evaluation  Center  (AFOTEC), 
located  at  Kirtland  AFB.  NM.  The  AFMC  has  three  Air  Logistics  Centers  (ALCs). 
which  are  located  at  Hill  AFB,  UT,  Wamer-Rohbins  AFB,  GA,  and  at  Tinker  AFB.  OK, 
which  is  ihe  focal  point  of  our  research. 

These  ALCs  perform  a  vital  mission  tor  the  AFMC  through  ihe  sustainment  of  all 
fielded  products,  which  is  approximately  70%  of  the  lifecycle  acquisition  costs.  There 
are  three  primary  areas  in  which  contracting  actions  are  traditionally  employed' 
operational,  systems  development,  and  susiainmenVsuppon.  Wiihm  these  areas  of 
conu^iing.  there  are  some  inherent  similaniies  and  differences. 

Operational  contracting  is  performed  at  every  Air  Force  installation  and  also  m 
deployed  environments.  This  method  of  contracting  usually  involves  actions  including 
commodities,  services,  and  consuniciion  support  for  the  specific  installation,  (n  addition, 
operational  contracting  can  entail  grounds  mainienance.  custodial  services,  roof  repair, 
other  various  services.  Each  installation  throughout  die  Air  Force  has  a  separate 
conu^iing  squadron/unii  that  performs  these  actions  to  help  support  die  installatioivbase 
For  example,  Laughim  AFB's  (located  in  Del  Rio,  Texas)  mission  is  to  provide 
undergraduate  pilot  training  (UPT)  for  future  fighter  pilots.  The  coniraciing  squadron  at 
Laughlin  supports  the  training  of  the  pilots  through  conu^is  that  perform  flight-line 
maintenance,  simulator  training,  and  even  aircraft  engine  maintenance. 
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System  development  conirdcitng  supports  the  procurement  of  weapon  systems, 
which  are  usually  located  at  product  centers.  These  product  centers  fall  under  their 
respective  MAJCOMs  and  are  located  at  the  AeronauiH:at  Systems  Center,  Elecuonlc 
Systems  Center,  Space  and  Missile  Center,  and  Air  Armament  Center.  These  centers 
hnve  numy  different  programs  that  span  a  vast  range  of  importance  and  dollar  value;  they 
are  meant  to  meet  a  future  need  or  a  new  threat.  The  FA-22,  Joint  Strike  Fighter,  and  the 
B-2  are  recent  examples  of  systems  development  contracting  actions. 

Sustainment/Support  contracting  is  usually  performed  at  logistics  centers,  which 
usually  maintain  the  product  center’s  fielded  programs.  The  Air  Force  has  three  air 
logistics  centers  These,  as  mentioned  above,  are  Ogden  ALC,  Wamer-Robbins  ALC,  and 
the  OC-ALC.  The  OC-ALC  is  one  of  the  largest  sustainment  centers  (air  logistics  center) 
in  the  Air  Force  The  ALCs'  mission  is  to  sustain  multiple  flying  platforms.  Sustainment 
conu^tmg  actions  in  each  center  support  the  maintenance  and  the  prolonging  of  the 
aircraft’s  lifespan  through  spares,  system  upgrades,  and  support  ei^uipment. 

Although  each  of  the  different  areas  of  contracting  support  different  mtaions  or 
functions,  there  are  some  similarities  among  them.  Foremost  is  that  no  matter  what  the 
conu^tmg  action  or  location,  the  contract  must  follow  the  regulations  and  stipulations  of 
the  FeJerxi/  Aa^utsition  Regu/uiion  {FAR)  and  the  appropriate  supplements,  when 
applicable.  In  addition,  each  of  the  contracting  actions  (operational,  systems 
development,  or  sustainment)  falls  within  the  six  key  process  areas  of  a  contract; 
procurement  planning,  solicitation  planning,  solicitation,  source  selection,  contract 
administration,  and  contract  closeout  ((tarret  &  Rendon,  2005).  The  subsequent  section 
will  discuss  the  OC-ALC's  background  information  and  also  why  the  OC-ALC  was 
chosen  for  analysis. 

C.  WHY  THE  OC* ALC? 

In  order  to  make  judgments  about  an  organization's  future,  it  is  necesary  to 
examine  its  past.  The  history  of  an  organization  is  critical  when  you  begin  to  discuss  its 
culture  and  mission.  Tinker  Air  Force  base  was  named  in  honor  of  Major  Genera) 
Clarence  L.  Tinker  of  Pawhuska.  Oklahoma,  alter  he  lost  his  life  while  leading  an  attack 
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tn  World  War  II.  The  base's  story  starred  in  )940  when  a  group  comprised  of  ctvic 
leaders  and  businessmen  learned  char  the  Defense  Department  was  looking  tor  a 
centralized  mainienance  depoi  for  ns  B-24,  B-17,  and  B-29  bomber  aircraft  (Global 
Security.  2007).  Tinker  siilt  upholds  bis  same  sustainment  mission,  bur  the  aircraft  have 
changed  significantly  since  then. 

Today,  the  base  supports  ihe  B-l.  B-2,  B-S2,  E-3.  K.C-I3S  (the  oldest  aircraft  in 
ihe  Air  Force  ai  4$  yearsK  ^nd  many  others,  using  over  26,000  military  and  civilian 
personnel  who  execute  over  I  S,000  coniracis  annually  (at  a  value  of  S3.3  billion)  (Air 
Force  Link,  2007).  Tinker  Air  Force  Base  is  home  to  the  Oklahoma  Ciry  Air  Logistics 
Center  and  several  major  associate  units,  including  the  SS2nd  Air  Control  Wing,  the 
Navy's  Strategic  Communications  Wing  One,  the  507th  Air  Refueling  Wing  and  the  3rd 
Combat  Communications  Group  (Tinker  Air  Force  Base,  2007). 

The  largest  organization  located  at  Tinker  is  the  DC-ALC.  It  is  housed  in  the 
longest  building  on  base  that  is  said  to  be  a  mile  long.  The  Center  supports  an  inventory 
of 2,26)  aircraft,  but  primarily  B-),  B-2,  B-52,  E-3,  VC-25,  E-4  aircraft  and  the  KC-135 
Also  included  in  iJte  Center’s  sustainment  mission  is  the  maintenance  of  nearly  23,000  jet 
engines  and  missile  systems  (e.g.,  air-launched  cruise  missiles,  conventional  cruise 
missiles,  harpoon,  etc  )  (Tinker  Air  Force  Base,  2007)  In  regards  to  other  units  within 
AFMC,  the  DC-ALC  has  one  of  the  largest  percentages  of  civilians  for  comparable  units 
Its  but  also  the  lowest  percentage  of  contractors  and  military  (Figure  S  below). 
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MBfttfy,  CIvlan,  aid  Contractor  DslAifflon  by  AFHC  Component 


■  CMUn  ftk)  ■  MCiry  fH)  □  CMiM  tk) 
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CsHs) 


Fissure  8.  PenoDDCI  Dixribuiloo  bv  AFMC  CompoDUDt 
(from  Venict  2007,  p*  J4) 


Thi^  vau  responsibility  is  maiu^ed  by  the  76*''  Mamiendnce  Wing.  327***  Aircrufl 
Sustainment  Wiog  (ASW),  448'“  Combat  Susiuinmeoi  Wing  (CSW),  and  the  72*^  Air 
Bose  Wiog  that  cotnpoee  the  OC-ALC  The  primary  fbeus  for  ibu  research  wiU  be  an  ibe 
ASW  and  the  CSW  (see  Tables  7  and  8  tn  next  section  Tor  a  liinher  breakdown).  The 
primary  mission  of  the  ASW  is  the  lifecyck  management  of  jircnifl,  while  We  mission  of 
We  CSW  is  We  world-wide  susuiiuDent  of  a  multitude  of  engioes.  These  rwo  wings  were 
selected  because  they  provide  an  oxcellest  furtim  in  which  to  conduct  ibe  CMMM  and 
knowledge  managemest  model— since  Weir  organizations  have  a  significant  number  of 
outsourced  ^grams  and  since  tbe  ALC  is  involved  in  n  magoioide  of  projects. 
Furthermore,  both  organizations'  contracting  divisions  predominantly  coretLst  of  DoD 
civilians  wbo  are  reurement-eitgible 

D.  OC*ALC  ACQULS  f TJ  ON  EXCELLED  CE  IN  ITATJ  \'E.S 

As  meatiooed  ui  Chapter  (,  We  OC-ALC  has  several  lAitiaiivea  designed  to 
improve  lU  workforce.  According  to  Mr.  Garry  Richey.  Executive  Director,  they 
include: 
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A.  Employee  developmeni  programs  (e.g.,  Civilian  Tuition  Assiaunce 
Program  (CTAP),  Tinker  Opporruniiieo  for  Professional  Service  (TOPS), 
atvj  Employee  Enhancement  Program  (EEP)) 

B.  Tinker  Lean  Insiirute 

C  Purchasing  and  Supply-choin  Management  (PSCM) 

The  Tinker  Lean  (nsiiruie  was  developed  lo  sundardjze  process  improvement 
training  and  lo  pepare  ihe  workforce  to  be  Transformation  "pamciponis."  (t  is  delivered 
by  Oklahoma  University  and  partners  in  the  area  which  have  trained  nearly  S,200 
employees.  The  training  is  conducted  in  three  process-improvement  methods; 

>  Lean 

>  Six  Sigma 

'  Supply-chain  Operations  Reference  (SCOR) 

For  Its  PSCM  initiatives,  the  OC-ALC  is  involved  with  the  following 
worksireams  according  to  Mr.  Oarry  Richey,  Executive  Director; 

•  Commodity  Councils 

•  Supplier  Relationship  Management 

•  Customer  Service  Centers 

•  Responsive  Sourcing 

•  Demand  and  Supply  Planning 

«  Advance  Planning  and  Scheduling 

•  Item  Unique  (denuticaiion 

•  Sena)  Number  Tracking 

There  are  several  keys  to  the  PSCM  efforts,  as  outlined  in  Table  6  below 
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EfTorK 

Benefits 

Customer  and  Supplier  Collaboration 

Weapon 

Flexible  Funding  Allocation 

Systems 

Strategic  Face  to  Customer 

AvailablUty 

Enterprise-wide  Commodity  Strategies 

Supply*cbtlo 

Strategic  Face  to  Supplier 

Cost  Reduction 

Real-time  Supply-chain  Visibility 

(nventory/Logistics  Sirategiea  Based  on  Demand 
Characieristica 

Supply  Plans  Based  on  Demand  Requirements 
(no  Purchase  Requests) 

Strategic  Conu^ts  Ibunded  on 
Commodity-based  Strategies 

Cycle*tlme 

(mprovcnicors 

T4blr  6.  OC'ALC  PurchtiJBf  4Bd  Suppiy^chala  MBBBgMnenl  laliUnv^t 


(From  Rjcrtey,  2007,  March) 


As  referenced  m  Figure  9  below,  the  supply  chain  is  a  complex  process  dial  must 
be  managed  m  a  diligent  manner.  Being  the  largest  ALC  in  AFMC,  Tinker  manages  die 
most  dynamic  supply  chain  m  ihe  Air  Force  PSCM  is  a  new  development  widiin  the  AF, 
and  successful  tmplemeniaiion  of  this  new  program  could  be  leveraged  to  other  units  ihai 
are  using  Strategic  Purchasing  (buying  as  one  unii)  concepts. 
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Fitiiife  9.  Sup|jl)  -ciiJiu  I'luH) 
(AtrerLainbert,  CDopw,  &  Pagh.  199S) 


Due  lo  coDiinued  scaree  resources,  ibe  DoD  can  no  longer  aftord  (o  procure  ui 
the  base  level  especially  when  similar  re^uiremeais  exist  ai  multiple  bases  If  the  Air 
Force,  for  tosiance,  has  similar  requiremeols  as  aoolher  service,  it  needs  to  eousolidaie 
those  to  maximize  quantity  discounts  and  improve  eRTciencios  in  its  processes.  The 
USA?  has  progressed  to  Commodity  Councils,  which  buy  iienis  for  the  whole  USAF. 
One  recent  addition  is  the  FT  Commodity  Council  at  Gunter  AFB,  AL.  The  personnel 
there  consolidate  requirements  and  procure  computers  tor  the  entire  USAF;  this  has  saved 
nearly  SI6  miUiOD  tferougb  quantity  discounis. 

According  to  the  OC-ALC  Executive  Directur.  the  OC-ALC  bas  already 
improved  its  efUciency  m  its  depot  mdinteoance  from  413  days  down  to  IS6.  We  need 
the  same  improvement  m  our  procuremeoi  functions  as  the  uicreased  ebadenges 
menuoned  in  the  beginning  of  this  project  increase;  civilian  retiremesis,  shrinking 
budgets,  and  a  downsized  force  For  ihese  reasons,  the  OC-ALC  implemented 
Purchasing  &  Supply-chain  Management  at  its  ALC  and  is  a  prone  candidate  to  test  tbc 
CMMM  and  Learning  Organization  AssessmenL 
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E. 


SUMMARY 


This  chapier  outlined  a  bnef  history  on  Tinker  Air  Force  base  and  how  it 
materialized,  thus  leading  lo  the  creation  of  the  OC-ALC.  Also  meniioned  is  how  the 
OC-ALC  was  selected  tor  the  application  of  the  CM  MM  and  the  knowledge  management 
questionnaires.  Furthermore,  the  paper  discussed  how  the  participants  for  the  study  and 
the  respective  number  of  personnel  that  were  to  pamcipaie  in  each  of  the  surveys  were 
chosen.  Additionally,  this  chapter  discussed  the  DC-ALC  initiatives  to  deal  with 
iranstbrmation— to  include  the  Lean  Institute,  Purchasing  and  Supply-chain 
Management,  and  Employee  development  progratm  Finally,  the  chapter  bnetly  covered 
how  the  questionnaires  were  administered  The  subsequent  chapter  will  discuss  the 
criteria  in  selecting  participants  as  well  as  the  results  of  the  CMMM  and  Learning 
Organization  Assessments.  It  will  include  pertinent  recommendations  embedded  m  each 
section,  and  show  any  correlation  derived  from  the  CMMM  and  Learning  Organization 
Assessments. 
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I V  .  KIND  IN  GS,  R£S  UL I S,  AN  D  RtCOMM  K  N  D  A 1  ION  S 


A.  INTRODUCTION 

This  chapter  wtl)  discuss  ihe  methodology  used  m  selecting  appropnoie 
quesiionnaire  paiticipant  candidates.  Subsequenily,  a  summary  of  the  findings  of  the 
CMMAT  and  Learning  Organization  Assessments  will  be  discussed,  along  with  any 
potential  correlatKins  between  the  two  models.  Also,  the  chapter  will  provide 
recommendations  for  the  OC-ALC  to  assist  in  improving  its  CM  processes  and 
procedures.  Additionally,  this  chapter  will  also  discuss  how  the  OC-ALC  can  improve  its 
learning  organizational  characteristics  found  to  need  improvement.  These  results  will 
help  the  center  posture  itself  for  success  as  it  implements  the  Contracting  Competency 
Model.  In  a  related  etlbn,  the  EkiD  Acquisition,  Technology  and  Logistics  (AT&L)  have 
developed  the  Human  Capita/  Slrule^c  Plan  which  requires  organizations  to  utilize  a 
Contracting  Competency  Model  with  an  organization’s  employees.  This  requirement  is 
set  to  be  executed  next  year  at  OC-ALC  and  will  be  discussed  further  in  Chapter  V 

B.  QUESTIONNAIRE  PARTICIPANT  SELECTION 

The  CMMM  calls  tor  specific  methods  for  selection  of  ns  participants— in  order 
to  ensure  they  include  a  “small,  purposive  sample”  (Oarren  &  Rendon,  2005,  p.  7f{).  This 
type  of  sample  is  used  because  the  CMMM  requires  inputs  from  individuals  who  have  the 
requisite  knowledge  base  to  evaluate  CM  processes  and  procedures,  described  in  further 
detail  below.  By  contrast,  the  Learning  Organization  Assessment  has  no  specific  method 
for  candidate  selection  The  ideal  sample  size  tor  the  analysis  of  the  OC-ALC  s 
conu^iing  division  is  around  30  Both  models  are  meant  only  to  take  a  “snap  shot  in 
time”  of  the  OC-ALC  s  management  of  contract  processes  and  knowledge-transfer 
practices.  Due  to  this  fact,  the  number  of  people  surveyed  using  the  CMMM  is  not 
considered  signiticani  (Oarrett  &  Rendon,  2005). 

As  mentioned  above,  the  pool  of  respondents  for  the  CMMM  questionnaire  must 
meet  two  cntena.  First,  the  individual  must  retain  a  D^paiiment  tyj  Dtjetife  Acquisition 


41 


tVorlcJiirce  Imp/vvemenl  Act  (DAtVlA)  Level  II  cemncaiion  in  Contreci  nunagemeni 
Secondly,  the  respondeni  must  hove  an  active  and  cuireni  warroni.  Do^tc  requirements  to 
obtain  a  DAWIA  Level  II  In  Contract  management  include  at  least  24  credit  hours  in 
business  administration  courses,  completion  of  the  EkiD  contracting  and  acquisition 
courses,  and  a  minimum  of  two  years  of  contracting  experience  (E>efense  Acquisiuon 
University  (U  S.>,  United  States,  Office  of  the  Under  Secretary  of  Defense,  Acquisiuon, 
&  United  Slates.  Office  of  the  Under  Secretary  of  Defense  for  Acquisition  and 
Technology,  2007).  Govenuneni  contracting  officers  are  appointed  and  have  express 
authority  to  enter  into,  administer,  and  terminate  conu^ts  (Oarreti  &  Rendon,  2005)  In 
addition,  the  contracting  officer  must  meet  a  special  review  board  to  obtain  a  warrant 
After  receiving  a  warrant,  the  contracting  officer  must  continually  maintain  proficiency 
with  at  least  ^0  hours  of  continuous  learning  credits  every  two  years  (Defense 
Acquisiuon  University  (U.S.),  United  States  Office  of  the  Under  Secretary  of  Defense, 
Acquisition,  United  States  Office  of  the  Under  Secretary  of  Defense  for  Acquisition 
and  Technology,  2007,  p.  viii). 

The  Learning  Organization  Assessment  does  not  have  any  requirements  for 
participation.  However,  due  to  the  nature  of  this  research,  individuals  with  less 
experience  were  targeted  in  effort  to  see  how  much  training  and  information  is  filtering 
down  to  the  lowest  level.  The  individuals  ai  these  levels  will  play  a  major  parr  of  the 
force  transformation  process  once  retirement-eligible  workers  begin  to  leave  the 
government  workforce. 

The  respondents  represent  the  following  groups  (that  fall  under  the  ASW  and 
CSV/)'  327'*’,  727*.  Td?”*,  and  the  B27**’  Aircrafl  Sustainment  Groups,  along  with  the 
446*.  74$l'\  646'*'.  and  the  94$!'*'  Combat  Susiainmeni  Groups.  Each  group  coninbuies  to 
the  overall  mission  that  was  discussed  in  Chapter  (((;  however,  the  following  Is  a  brief 
description  of  each  of  their  missions  (Tinker  Air  Force  Base,  2007).  We  surveyed  66 
personnel,  with  IS  responding,  fora  22%  response  rate.  Among  the  respondents,  the 
average  conu^iing  officer’s  experience  is  S  years  warranted,  plus  5  years  on  average  as 
a  buyer/contracts  specialist,  for  a  total  of  10*  years  experience  A  breakout  of  the  Air 
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LogisDcs  Cenier  organiuitons,  wiih  missions  and  oircroif  supported  can  be  seen  below  in 
Tables?  and  S; 


Aircraft  Sustainment  Wing  (ASW) 

OrtanbailM 

MMJon 

Aircraft  Supporred 

32’^  Airwafl 

Su«t£]Dti>efil  Oroop 

Manas?  li(^>’?l*  ^ustainriwtii  and 

noJ(?rt)L2aiiori 

B-52 

227“  Airctan 

Su«t£]Dti>efil  Oroop 

CoMnctor  logMci  uuJ 

ftiuidgeftiCAt  support 

All  USaF  oommanal 

denvaovc  aiKrall 

7<7'*  Aifctafl 

SusiBianwfU  Group 

Orclinirate  prodiKi  aufpon  activiiwa 

aitd  logBiios  suptaon  to  customcit  aitd 

oombaiBfii  cotnmaodm 

B-l.  B-Z  L'S  and  FoteitnE- 

3  AWACS 

S2Tth  ^irctafl 

Su«t£]atnefii  Group 

Global  Reach  and  Global  Posi'er  Ae 

refiMling  euftfton 

KC-135 

Tabic  7.  ASW  OrganLzailoool  Missions  and  Aircraft  Supposed 


Combat  Susttlomcot  Wlog  (CSW) 

Organ  baiM 

Milt  ton 

Mrrraft  Snpporred 

44Sfh  Coftibai 

Suaiainmnn  Group 

Pros  id?  cor?  progratn,  nnaficial 

coniraci,  and  supply  cltain 

managcmeiit  tuppon 

FIOO.  Tm  Engines 

74Slh  Coinhai 

Susiainmnn  Group 

MAtiijctncfii  mpofiuhililtcc  incUnfc 

^uiaiiton,  logitiKt,  repair,  aioragc, 

diairibuiton,  diapoaal  and  tedmicaJ 

and  mg  1  neon ngse meet 

FlOl  Fin?.  FII2,FI0lt, 

FII0,FIIS,  156,  TF3d, 

TF39,IS5, 169,  l?9  and 

HclKopicr  engines 

S4Sfh  Coftibai 

Suaiainmnn  Group 

Provide  world  V.  id?  tuetAintnmi 

euppon  of  aobomc  acccasonrr, 

siraicTuiaJ,  av  loiuca  and  inanuncm 

related  commodity  items  operated  by 

ID?  Air  Force,  Navy  and  foreign 

countries 

Com  modules 

Tables.  CSWi 

□^antsAtloaal  Mlasibas  abd  Aircraft  Supported 
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The  groups  listed  above  were  chosen  for  analysis  because  each  of  them  has 
contracts  that  span  the  entire  contract  fflanagemeni  lifecycle.  By  including  data  from 
each  group,  ihe  researchers  are  able  lo  Hdendfy  capability  or  knowledge  defKiencies 
wiihin  each  group  and  laikir  specific  recommendations  in  training  and  or  education  for 
each  group  (Uarren  &  Rendon,  2005).  Moreover,  the  results  gathered  will  inform 
management  options  to  leverage  best  practices  from  one  group  to  another,  thus  improving 
the  organization  as  a  whole. 

C.  CONTRACT  MANAGEMENT  MATURITY  ASSESSMENT  TOOL 

RESULTS 

As  discussed  in  Chapter  III,  the  OC-ALC  is  compnsed  of  multiple  groups  that  fall 
within  TWO  wings  ( Aircraft  Sustainment  Wing  (ASW)  and  the  Combat  Sustainment  Wing 
(CSW)).  This  section  will  provide  the  results  of  the  CMMAT  questionnaire,  which  is 
separated  into  the  six  contract  management  processes'  Procurement  Planning,  Solicitation 
Planning,  Solicitation,  Source  Selection,  Contract  Administraiion,  andConiraci  Closeout 
(Garret  &  Rendon,  2005). 

The  findings  will  be  broken  down  by  group  (eg.,  the  727'*'  Aircraft  Sustainment 
(iroup)  and  then  aggregated  into  an  enterprise  maturity  level  Enterprise  in  this  context 
refers  to  contract  management  processes  taking  place  within  both  the  ASW  and  CSW 
wings.  This  section  will  also  provide  recommendations  to  the  CM  leadership  at  the  OC- 
ALC  on  how  it  might  advance  to  the  next  maturity  level. 

Figure  11  provides  a  listing  of  each  process,  the  OC-ALC's  maturity  score,  and 
the  corresponding  level  of  process-capability  maturity.  As  shown  in  the  Egure,  all  the 
maturity  levels  for  each  individual  group  of  the  DC- ALC  ranged  from  1  "Ad-hoc”  to  4 
"(niegraied  ”  The  Combat  Sustainment  Group  had  the  highest  maTunty-level  rating 
("Integrated")  across  the  four  key  process  areas;  Procurement  Planning,  Solicitation 
Planning,  Solictiaiion,  and  Source  Selection.  The  lUS'**  Combat  Sustainment  (iroup  had 
the  lowest  maturity-level  rating  ("Ad-Hoc")  in  two  key  process  areas  of  Contract 
Administration  and  Contract  Closeout 
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Figure  10.  OC*ALC  Coairucl  MtmigvmeDl  Maiurily  A&svsyiinciit  Tool  RmuUs 

(From  Gfiireif  &  Rendon.  2005) 


The  above  re&ulii  are  derived  from  employee  responses  (o  ihe  Coulrari 
Memogemeni  Maiiiniy  Model  Asseesmeni  Tool  (CMMAT)  This  qucsiioiuidire  cansisie<l 
of  60  questions,  wiih  eateries  that  tnc)iide±  1  *  ''never,'  2  *  ''seldom,’'  i  * 
"Komeumes,"  4  -  “usually,'*  S  >  Always,  and  DK.  *  Don’t  Know.  It  should  be  noted  that 
“Don't  Know"  responses  et|iiaies  to  a  negative  impact  on  the  scoring  of  the  quesuonnaire 
A  score  of  zero  is  given  for  each  Don’t  Know  response  because  each  paitidpaoi,  based 
on  his/her  position  and  responsibility,  should  have  a  basic  understanding  of  the 
organization's  CM  proces^v  and  procedure's.  The  following  paragraphs  discuss  the 
results  ut  further  detail  and  provide  insight  into  each  unit  (Wing,  Group,  etc.). 

1 .  7271  b  Aircraft  Sustal  iimciii  G  roup 

In  the  727*  AircruA  Sustainment  Group,  three  individuals  provided  responses.  Of 
the  180  quesuons  an.«W'ered  {60  questions  for  each  of  the  three  poiticipiuiis),  10  were  in 
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itK  “never”  category;  32  were  in  the  ^'seldom”  caiegoty,  and  30  were  in  the  “sometimes” 
category.  The  remaining  responses  were  in  the  “usually”  or  higher  categorres.  The 
overall  maturity  level  was  rated  as  “Structured”  across  the  six  key  process  areas; 
Procurement  Planning.  Solicitailon  Planning,  Solicltarion.  Source  Selection,  Contract 
Administration,  and  Contract  Closeout 

This  CMM  assessment  indicates  that,  based  on  the  survey  responses  for  the  727* 
Aircraft  Sustainment  Group,  contract  management  processes  and  standards  are  fully 
established,  instiTutionalized  and  numdated  throughout  the  entire  organization. 
Additionally,  forma)  documentation  has  been  developed  for  these  contract  management 
processes  and  standards,  and  some  processes  may  even  be  automated.  Also,  since  these 
conu^i  management  processes  are  mandated,  the  organization  allows  the  tailoring  of 
processes  and  documents,  allowing  consideration  for  the  unique  aspects  of  each 
conu^i— such  as  contracting  strategy,  contract  type,  terms  and  conditions,  doDar  value, 
and  type  of  requirement  (product  or  service).  Finally,  senior  management  is  involved  m 
providing  guidance,  direction,  and  even  approval  of  key  contracting  strategy,  decisions, 
related  contract  terms  and  conditions,  and  conu^t  management  documents  (Oarrett  & 
Rendon,  2005). 

2.  747ih  Aircraft  Sustainment  Group 

In  the  747*  Aircraft  Sustainment  Group,  three  individuals  provided  responses.  Of 
the  1 60  questions  (60  questions  times  for  each  of  the  participants),  22  were  in  the  “Don’t 
Know”  category;  21  were  in  the  “Seldom”  category,  and  42  were  in  the  “Sometimes” 
category.  The  remaining  responses  were  m  the  “Usually”  or  higher  categories.  The 
highest  maturity  level  was  “Structured“  across  four  key  process  areas'  Procurement 
Planning,  Solicitation  Planning.  Sollatailon,  and  Source  Selection.  The  group’s  lowest 
maturity  level  was  “Basic”  in  the  two  key  process  areas  of  Contract  Administration  and 
Contract  Closeout 

This  CMM  assessment  indicates  that  based  on  the  survey  responses  for  the  747* 
Aircraft  Sustainment  Group  in  the  key  process  areas  of;  Procurement  Planning, 
Solicitation  Planning,  Solicitation,  and  Source  Selection,  contract  management  processes 
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iind  siandards  are  fully  esubli^ed,  insiituiionalized  ajid  mandated  ihroughoui  ihe  entire 
organizaiion  Addiiionally,  formal  documeniaiion  has  been  develO[)ed  for  ihe«e  contract 
management  [irocessea  and  atatvjards,  and  some  processes  may  even  be  automated  Also, 
since  these  contract  management  processes  are  mandated,  the  organuation  allows  the 
tailoring  of  processes  and  documents,  allowing  consideration  for  the  unique  aspects  of 
each  contract — such  as  contracting  strategy,  contract  type,  terms  and  conditions,  dollar 
value,  and  type  of  requirement  (product  or  service).  Finally,  senior  management  is 
involved  in  providing  guidance,  direction,  and  even  approval,  of  key  contracting  strategy, 
decisions,  related  contract  terms  and  conditions,  and  contract  management  documents 
(Garrett  A  Rendon,  200S). 

For  the  key  process  areas  of  Contract  Administration  and  Contract  Closeout,  this 
CMM  assessment  indicates  that  based  on  the  survey  responses  for  the  747*'  Aircraft 
Sustainment  Group,  it  has  some  basic  contract  management  processes  and  standards 
established  within  the  organiaaiion.  These  basic  processes  are  required  only  on  selected 
complex,  cniical,  or  high-visibility  contracts,  such  as  contracts  meeting  certain  dollar 
thresholds,  or  contracts  with  certain  customers  Also,  some  tbrmal  documentation  has 
been  developed  for  these  established  contract  management  processes  and  standards 
Additionally,  the  organization  does  not  consider  these  contract  management  processes  or 
standards  established  or  institutionalized  throughout  the  entire  organization.  Finally, 
there  is  no  organizational  policy  requiring  the  consistent  use  of  these  contract 
management  processes  and  standards  other  than  on  the  required  contracts  (Garrett  & 
Rendon,  2005). 

3.  827th  Aircraft  Sustainment  Group 

In  the  827***  Aircraft  Sustainment  Group,  only  one  individual  provided  a  response 
Of  the  60  questions  answered,  0  were  rated  In  the  “never”  category,  13  were  in  the 
“seldom"  category,  and  27  were  in  the  ^'sometimes*'  category.  The  remaining  responses 
were  m  the  “usually”  or  higher  categories.  The  highest  maruriiy  level  was  '‘Sirucnired” 
across  ftve  key  process  areas'  Solicitation  Planning,  Solicitation,  Source  Selection, 
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Contraci  Administrauon  iind  Coniraci  Closeoui.  The  group’s  lowest  tnaiuriiy  level  was 
“Basic”  in  the  key  process  area  of  Procurement  Planning. 

This  CMM  assessfneni  indicates  that  based  on  the  survey  responses  for  ihe  827*^ 
Aircraft  Sustainmeni  Group  in  the  key  process  areas  of  Solicitation  Planning. 
Soliciiaiton,  Source  Selection,  Contract  Administration  and  Coniraci  Closeout,  contract 
management  processes  and  standards  are  fully  established,  instiiutKinalized  and  mandated 
throughout  ihe  entire  organization.  Additionally,  formal  documentation  has  been 
developed  for  these  contract  management  processes  and  standards,  and  some  processes 
may  even  be  automated.  Also,  since  these  contract  management  processes  are  mandated, 
the  organization  allows  the  tailoring  of  processes  and  documents,  allowing  consideration 
for  the  unique  aspects  of  each  contract— such  as  contracting  strategy,  contract  type,  terms 
and  conditions,  dollar  value,  and  type  of  requirement  (product  or  service)  Finally,  senior 
management  is  involved  m  providing  guidance,  direction,  and  even  approval,  of  key 
conu^iing  strategy,  decisions,  related  contract  terms  and  conditions,  and  contract 
management  documents  (Garrett  &  Rendon,  200S) 

For  the  key  process  area  of  Procurement  Planning,  this  CMM  assessment 
indicates  that  based  on  the  survey  responses  tor  the  827*''  Aircraft  Sustainment  Group,  it 
has  some  baste  contract  management  processes  and  standards  established  within  the 
organization.  However,  these  basic  processes  are  required  only  on  selected  complex, 
critical,  or  high-visibility  contracts,  such  as  contracts  meeting  certain  dollar  thresholds  or 
conu^is  with  certain  customers  Also,  some  formal  documentation  has  been  developed 
for  these  established  contract  management  processes  and  standards.  Additionally,  the 
organization  does  not  consider  these  contract  management  processes  or  standards 
established  or  institutionalized  throughout  the  entire  organization  Finally,  there  is  no 
organizational  policy  requiring  the  consistent  use  of  these  contract  management  processes 
and  standards  other  than  on  the  required  contracts  (Oarreti  &  Rendon,  200S). 

4.  44^h  Combat  Sustain  nient  <»  roup 

In  the  44$'*'  Combat  Sustainment  Group,  four  individuals  provided  responses.  Of 
the  240  questions  answered  it>0  questions  for  each  of  the  4  participants),  1 1  were  rated  as 
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"Don’i  Know";  I  was  rated  m  the  "Never”  category;  18  were  in  ihe  "Seldom”  category, 
and  49  were  in  the  "Sometimes"  category.  The  remaining  responses  were  in  the 
"Usually”  or  higher  categories.  The  highest  maturity  level  was  "Integrated”  across  four 
key  process  areas:  Procurement  Planning,  SoliciiatNan  Planning,  Solicitation,  and  Source 
Selection.  The  group  received  a  rating  of  "Structured”  in  the  key  process  area  of 
Contract  Administration,  and  their  lowest  maturity  level  was  "Basic”  in  the  key  process 
area  of  Contract  Closeout 

This  CMM  assessment  indicates  that  based  on  the  survey  responses  for  the  448* 
Combat  Sustainment  Group  in  the  key  process  areas  of  Procurement  Planning, 
Solicitation  Pbnning,  Soliciiaiion,  and  Source  Selection,  it  has  basic  contract 
management  processes  that  are  integrated  with  other  organizational  core  processes  such 
as  cost  control,  schedule  management,  performance  management  and  systems 
engineering.  Also,  the  procurement  project's  end-user  customer  is  an  integral  member  of 
the  procurement  team  Additionally,  management  uses  efficiency  and  efteciiveness 
metrics  lo  make  procurement-related  decisions,  and  management  understands  its  role  in 
the  procurement  process  and  executes  the  process  well  (Garrett  &  Rendon,  200S1. 

For  the  key  process  area  of  Conu^i  Administration,  this  CMM  assessment 
indicates  that  based  on  the  survey  responses  tor  the  448'*'  Combat  Sustainment  Group,  it 
has  conu^i  management  processes  and  standards  are  fully  established,  insuruuonalized 
and  mandated  throughout  the  entire  organization  AddmonaDy.  formal  documentation 
has  been  developed  for  these  contract  management  processes  and  standards,  and  some 
processes  may  even  be  automated.  Also,  since  these  contract  management  processes  are 
mandated,  the  organization  allows  the  tailoring  of  processes  and  documents,  allowing 
consideration  for  the  unique  aspects  of  each  contract— such  as  contracting  strategy, 
conu^i  type,  terms  and  conditions,  dollar  value,  and  type  of  requirement  (product  or 
service)  Finally,  senior  management  is  involved  in  providing  guidance,  direction,  and 
even  approval,  of  key  contracting  strategy,  decisions,  related  contract  terms  and 
conditions,  and  contract  management  documents  (Garrett  &  Rendon,  2005). 

For  the  key  process  area  of  Contract  Closeout,  this  CMM  assessment  indicates 

that  based  on  the  survey  responses  for  the  448'''  Combat  Sustainment  Group,  it  has  some 
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baskc  coniract  fnarugemeni  processes  and  standards  esiablished  wiihm  the  organization 
TtKse  baste  pfocesses  are  required  only  on  selected  complex,  critical,  or  htgb-visibility 
contracts,  sueb  as  contracts  meeting  certain  dollar  thresholds  or  contracts  with  certain 
customers.  Also,  some  formal  documentation  has  been  developed  for  these  established 
contract  management  processes  and  standards.  Additionally,  the  organization  does  not 
consider  these  contract  management  processes  or  standards  established  or 
institutionalized  throughout  the  entire  organization.  Finally,  there  is  no  organizaiiona) 
policy  requiring  the  consistent  use  of  these  contract  management  processes  and  standards 
other  than  on  the  requireil  contracts  (Garrett  &  Rendon,  200S1. 

5.  748Th  Combai  Susiaiii  meiit  <i  roup 

In  the  74B'*'  Combat  Sustainment  Group,  only  one  individual  provided  a  response 
Of  the  60  questions  answered,  I  was  rated  as  *'Don’i  Know’'  0  were  rated  in  the  ’’Never” 
category;  13  were  in  the  “Seldom”  category,  and  25  were  in  the  “Sometimes"  category. 
The  remaining  responses  were  in  the  “Usually”  or  higher  categories.  The  highest 
maturity  level  was  “Structured”  across  four  key  process  areas:  Solicitation  Planning, 
Solicitation,  Source  Selection  and  Contract  Administration.  The  group's  lowest  maturity 
level  was  "Basic”  in  the  key  process  areas  of  Procurement  Planning  and  Contract 
Closeout. 

This  CMM  assessment  indicates  that  based  on  the  survey  responses  for  the  74B* 
Combat  Sustainment  Group  in  the  key  process  areas  of:  Solicitation  Planning, 
Solicitation,  Source  Selection  and  Contract  Administration,  it  has  contract  management 
processes  and  standards  which  are  fully  established,  institutionalized  and  mandated 
throughout  the  entire  organization.  Additionally,  formal  documentation  has  been 
developed  for  these  contract  management  processes  and  standards,  and  some  processes 
may  even  be  automated.  Also,  since  these  contract  management  processes  are  mandated, 
the  organization  allows  the  tailoring  of  processes  and  documents,  allowing  consideration 
for  the  unique  aspects  of  each  contract— such  as  contracting  su^egy,  contract  type,  terms 
and  conditions,  dollar  value,  and  type  of  requirement  (product  or  service)  Finally,  senior 
management  is  involved  in  providing  guidance,  direction,  and  even  approval,  of  key 
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coniracDng  strategy,  decisions,  related  contract  terms  and  condriions,  and  contract 
management  documents  (Garrett  &  Rendon,  2005) 

For  the  key  process  areas  of  Procuremeni  Planning  and  Contract  Closeout,  this 
CMM  assessment  indicates  that  based  on  the  survey  responses  for  the  74S"'  Combat 
Sustainment  Group,  it  has  some  basic  contract  management  processes  and  standards 
established  within  the  organization.  These  basic  processes  are  required  only  on  selected 
complex,  critical,  or  high-visibility  contracts,  such  as  contracts  meeting  certain  dollar 
thresholds  or  contracts  with  certain  customers.  Also,  some  formal  documentation  has 
been  developed  for  these  established  contract  management  processes  and  standards 
Additionally,  the  organization  does  not  consider  these  contract  management  processes  or 
standards  established  or  institutionalized  throughout  the  entire  organization.  Finally, 
there  is  no  organizational  policy  requiring  the  consistent  use  of  these  contract 
management  processes  and  standards  other  than  on  the  required  contracts  (Garrett  & 
Rendon,  200S). 

6.  &48ih  CoiDbai  .Sustain  nieiii  Crroup 

In  the  Combat  Sustainment  Group,  three  individuals  provided  responses.  Of 
the  180  questions  answered  (60  questions  for  each  of  the  three  participants),  35  were 
rated  as  “Don’t  Know";  2  were  rated  in  the  “Never"  category;  13  were  in  the  “Seldom" 
category,  and  33  were  in  the  “Sometimes"  category.  The  remaining  responses  were  in 
the  “Usually"  or  higher  categories.  The  highest  maturity  level  was  “Strucrured"  across 
four  key  process  areas;  Procurement  Planning,  Solicitation  Planning,  Solicitation,  and 
Source  Selecuon.  The  group's  lowest  marurity  level  was  “Ad-Hoc’'  in  the  key  process 
areas  of  Contract  Administration  and  Contract  Closeout 

This  CMM  assessment  indicates  that  based  on  the  survey  responses  for  the  848^ 
Combat  Sustainment  Group  in  the  key  process  areas  of  Procurement  Planning, 
Solicitation  Planning,  Solicitation,  and  Source  Selection,  it  has  contract  management 
processes  and  standards  are  fully  established,  instirutionalized  and  mandated  throughout 
the  entire  organization.  Additionally,  formal  documentation  has  been  developed  for 
these  contract  management  processes  and  standards,  and  some  processes  may  even  be 
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iiijiomaieil  Also,  stnce  these  contract  managetneni  processes  are  mandated,  the 
organizaiion  allows  the  tailoring  of  processes  and  documents,  allowing  consideration  for 
the  unique  aspects  of  each  contract — such  as  contracting  strategy,  contract  type,  terms 
and  conditions,  dollar  value,  and  type  of  requirement  (product  or  service)  Finally,  senior 
management  is  involved  in  providing  guidance,  direction,  and  even  approval,  of  key 
conu^ting  strategy,  decisions,  related  contract  terms  and  conditions,  and  contract 
management  documents  (Garrett  &  Rendon,  2005) 

For  the  key  process  areas  of  Contract  Administration  and  Contract  Closeout,  this 
CMM  assessment  indicates  that  based  on  the  survey  responses  for  the  Combat 
Sustainment  Group,  it  has  CM  processes  that  are  accepted  and  practiced  throughout 
various  industries.  In  addition,  the  organization’s  management  understands  the  benefit 
and  value  of  using  contract  management  processes.  Also,  although  there  are  not 
organization-wide,  established  basic  contract  management  processes,  some  established 
conu^i  management  processes  evist  and  are  used  within  the  organization  Yet,  these  are 
applied  only  on  an  “ad-hoc”  and  sporadic  basis  on  various  contracts.  Additionally, 
informal  documentation  of  contract  management  processes  may  exist  within  the 
organization,  but  are  used  only  on  an  “ad-hoc”  and  sporadic  basis  on  various  contracts 
Finally,  organizational  managers  and  contract  management  personnel  are  not  held 
accountable  for  adhering  to,  or  complying  with,  any  contractual  processes  or  standards 
(Garrett  &  Rendon,  200S). 

7.  CMMM  Asscssmeot  Results  oi  the  Enterprise  Level 

For  the  contract  managemeni  maturity  assessed  at  the  enterprise  level,  of  the  60 
questions  answered,  the  overall  assessment  resulted  in  a  “Basic”  matunty  level  for  the 
key  process  area  of  Procurement  Planning,  a  “Structured”  maturity  level  for  the  key 
process  areas  of  Solicitation  Planning,  Solicitation,  and  Source  Selection,  an  “Ad-Hoc” 
maturity  level  for  the  key  process  areas  of  Contract  Administration  and  Contract 
Closeout.  Enterprise  in  this  context  refers  to  contract  managemeni  processes  that  occur 
within  both  the  ASW  and  CSW  wings.  These  ratings  were  determined  by  taking  the 
lowest  score  from  each  group  within  each  key  process  area  The  reasoning  behind  this 
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me(ho<j  is  because  CM  [irocesses  are  much  like  a  chain;  they  can  only  be  as  strong  as 
ibeir  weakest  hnk.  In  this  case,  ihe  OC-ALC  can  only  be  as  strong  as  its  weakest  (least 
mature)  unit  within  each  of  the  six  CM  process  areas  (Oarrett  &  Rendon,  ZOOS). 

For  the  key  process  area  of  Procurement  Planning,  the  overall  assessment  based 
on  the  survey  responses  for  the  enterprise  found  a  "Basic”  matunty  level  This  rating 
indicates  that  the  Group  has  some  basic  contract  management  processes  and  standards 
established  within  the  organization.  These  basic  processes  are  required  only  on  selected 
complex,  critical,  or  hlgh-visibility  contracts,  such  as  contracts  meeting  certain  dollar 
thresholds,  or  contracts  with  certain  customers  Also,  some  tbrmal  documentation  has 
been  developed  for  these  established  contract  management  processes  and  standards 
Additionally,  the  organization  does  not  consider  these  contract  management  processes  or 
standards  established  or  institutionalized  throughout  the  entire  organization.  Finally, 
there  Is  no  organizational  policy  requiring  the  consistent  use  of  these  contract 
management  processes  and  standards  other  than  on  the  required  contracts  (Garrett  & 
Rendon,  ZOOS). 

For  the  key  process  areas  of  Solicitation  Planning,  Solicitation,  and  Source 
Selection,  the  overall  assessment  for  the  enterprise  found  a  “Structured''  maturity  level 
This  rating  indicates  that  it  has  contract  management  processes  and  standards  that  arc 
fully  established.  These  processes  are  also  institutionalized  and  mandated  throughout  the 
entire  organization.  Additionally,  formal  documentation  has  been  developed  for  these 
conu^i  management  processes  and  standards,  and  some  processes  may  even  be 
automated.  Also,  since  these  contract  managemeni  processes  are  mandated,  the 
organization  allows  the  tailoring  of  processes  and  documents,  allowing  consideration  for 
the  unique  aspects  of  each  contract — such  as  contracting  strategy,  contract  type,  terms 
and  conditions,  dollar  value,  and  type  of  requirement  (product  or  service)  Finally,  senior 
managemeni  is  involved  m  providing  guidance,  direction,  and  even  approval,  of  key 
conu^iing  strategy,  decisions,  related  contract  terms  and  conditions,  and  contract 
management  documents  (Garrett  &  Rendon,  2005) 

For  the  key  process  areas  of  Contract  Administraiion  and  Contract  Closeout,  the 

overall  assessment  based  on  the  survey  responses  for  the  enterprise  showed  an  “Ad-Hoc” 
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macunry  level.  Tliis  rating  indicates  ihai  the  organiiaiion  has  contract  management 
processes  that  are  accepieil  and  practiced  throughout  various  tndusines.  (n  addition,  ihe 
organization's  management  understands  the  benefit  and  value  of  using  contract 
management  processes  Although  there  are  noi  organization-wide,  established  basic 
conu^t  managemeni  processes,  some  established  conu^t  management  processes  exist 
and  are  used  within  the  organization,  but  are  applied  only  on  an  "ad-hoc’'  and  sporadic 
basis  on  various  contracts  Additionally,  informal  documentation  of  contract  management 
processes  may  exist  within  the  organization,  but  are  used  only  on  an  "ad-hoc”  and 
sporadic  basis  on  various  contracts.  Finally,  organizational  managers  and  contract 
management  personnel  are  not  held  accountable  for  adhering  to,  or  complying  with,  any 
conu^tual  processes  or  standards  (Oarrett  &  Rendon,  ZOOS). 

One  factor  that  caused  the  enterprise  rating  to  drop  was  the  response  of  "Don't 
Know"  on  the  Contract  Administration  and  Contract  Closeout  questionnaires  for  the 
Combat  Sustainment  Ciroup  Again,  per  the  CMMM,  a  "Don’t  Know"  response  to  any 
question  will  result  in  a  neutral  score,  in  this  case  a  "zero."  Clearly,  some  education  on 
what  these  processes  entail  would  enable  the  responder  to  better  answer  the  question 
(•ranted,  the  646'^  may  not  be  involved  in  contract  adminisiraiion  or  conu^  closeout, 
but  employees  should  be  aware  of  the  process.  The  way  contracts  are  structured  (e.g.. 
number  of  contract  line  items  (CLlNsK  terms  and  conditions,  etc.)  can  determine  how 
easy  or  difficult  will  be  lo  closeout  the  coniraci.  As  an  example,  the  Titan  Contract  at 
SMC  had  numerous  CLlNs  with  many  Sub-CLINs,  which  io<A  several  years  lo  closeout 
There  is  a  direct  correlation  between  the  amount  of  CLlNs,  or  the  complexity  of  the 
conu^i  terms  and  conditions,  and  the  length  it  will  take  for  the  government  to  recover  its 
funds  through  the  contract  closeout  process  When  a  workforce  continues  to  decrease,  all 
employees  need  to  be  flexible  and  understand  all  the  key  process  areas  because  they  may 
be  called  upon  to  do  new  tasks  on  short  nonce. 
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D.  PROC  E5S  I  \tPRO VEMENT  ROA  DM AP  FOR  TliE  CMMM 

This  CMMM  a^ses&ment  conducted  oi  ctK  OC-ALC  pfovides  vtmt  key  insights 
into  the  enterpnse’s  matuniy  level  in  each  of  the  siv  process  areas.  The  tbiiowmg 
recommendaiions  are  ways  the  enterprise  can  improve  its  maninry  within  each  coniroci 
management  process  area. 

1 .  Procurcmeot  Planning 

The  enterprise,  based  on  the  results  of  this  CMMM  assesment,  received  a 
maturity  level  of  “Basic”  in  the  CM  process  area  of  procurement  planning  To  achieve  a 
“Strucriired''  rating,  it  needs  to  have  in  place  contract  management  processes  and 
standards  that  are  fully  established,  institutionalued  and  mandated  throughout  the  entire 
organization  Additionally,  formal  documentation  should  be  developed  for  these  contract 
management  processes  and  standards,  and  some  processes  should  be  automated.  The 
organization  should  allow  the  tailoring  of  processes  and  documents,  allowing 
consideration  for  the  unique  aspects  of  each  contract— such  as  contracting  strategy, 
conuoct  type,  terms  and  conditions,  dollar  value,  and  type  of  requirement  (product  or 
service!.  Finally,  senior  management  needs  to  be  more  involved  in  providing  guidance, 
direction,  and  even  approval,  of  key  contracting  strategy,  decisions,  related  contract  terms 
and  conditions,  and  contract  management  documents  (Oarrert  &  Rendon,  ZOOS). 

Another  recommendation  is  for  the  enterprise  to  leverage  some  of  the  more 
mature-rated  groups’  (e.g.,  44!^'''  Combat  Sustainment  (iroup)  processes  with  the  lower- 
rated  matunty  level  units.  The  enterprise  should  also  develop  and  implement  the  use  of 
etliciency  and  effecitveness  metrics  and  establish  a  lessons-leamed  and  best-practices 
database  for  the  procurement  planning  process.  These  practices  would  also  be  effective 
in  increasing  the  maturity  level  to  “Optimized”  (Oarret  &  Rendon,  ZOOS). 

2.  .Sniiciiatieii  PIODiilng 

The  enterprise,  based  on  the  results  of  this  CMMM  assessment,  received  a 
maturity  level  of  “Structured”  in  the  CM  process  area  of  solicitation  planning.  To 


55 


achieve  an  "Iniegraied”  rating,  ii  should  integrate  the  basic  contract  management 
processes  with  oihee  organizational  core  processes  such  as  cost  control,  schedule 
management,  performance  management  and  systems  engineering.  Also,  ihe  procurement 
project's  end-user/cusiomer  should  be  an  integral  member  of  the  procurement  team 
Additionally,  managemeni  should  use  efliciency  and  effectiveness  metrics  to  make 
procurement-related  decisions,  and  managemeni  should  understand  its  role  in  the 
procurement  process  and  execute  the  process  well  (Oarreit  &  Rendon,  2005). 

Additionally,  the  enterprise  can  leverage  some  of  the  more  mature  groups’  (e,g., 
446*  Combat  Sustainment  Group)  capability,  which  will  facilitate  the  maturation  of  the 
processes  of  the  lower-rated  units.  The  enterprise  should  also  develop  and  implement  the 
use  of  efficiency  and  effectiveness  metrics  and  establish  a  lessons-leamed  and  best- 
practices  database  for  the  procurement  planning  process  These  practices  would  also  be 
effective  in  raising  the  moTunty  level  to  "Optimized”  (Garret  &  Rendon,  2005). 

3.  .Sniiciiatioii 

The  enterprise,  based  on  the  results  of  this  CMMM  assessment,  received  a 
maturity  level  of  "Structured"  in  ihe  CM  process  area  of  solicitation.  To  achieve  an 
"Inregrated"  rating,  the  enterprise  should  integrate  the  basic  contract  management 
processes  with  other  organizational  core  processes  such  as  cost  control,  schedule 
management,  performance  managemeni  and  systems  engineering.  Also,  ihe  procurement 
project's  end-user/cusiomer  should  be  an  integral  member  of  the  procurement  team 
Additionally,  managemeni  should  use  efficiency  and  effectiveness  metrics  to  make 
procuremeni-rebted  decisions,  and  managemeni  should  understand  its  role  in  the 
procurement  process  and  execute  the  process  well  (Garrett  &  Rendon,  2005). 

Another  recommendation  is  for  the  enterprise  to  leverage  some  of  the  more 
mature-rated  groups’  (e.g.,  446'*'  Combat  Sustainment  Group)  processes  with  the  lower¬ 
rated  matunty  level  units.  The  enterprise  should  also  develop  and  implement  the  use  of 
etliciency  and  effectiveness  metrics  and  establish  a  lessons-leamed  and  best-practices 
database  for  the  procurement  planning  process.  These  practices  would  also  be  effective 
in  increasing  the  maturity  level  to  "Optimized"  (Garret  &  Rendon,  2005). 
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4, 


Source  Selection 


TtK  enterpri&e,  based  on  ihe  results  of  this  CMMM  as&esimeni,  received  a 
matunry  level  of  *'Sinicnired’'  in  the  CM  process  area  of  source  selection  To  achieve  an 
“Iniegrated”  rating,  the  enterprise  should  integrate  the  basic  contract  management 
processes  with  other  organizational  core  processes  such  as  cost  control,  schedule 
management,  performance  management  and  systems  engineering.  Also,  the  procurement 
project's  end-user/customer  should  be  an  integral  member  of  the  procurement  team 
Additionally,  management  should  use  etTiciency  and  effectiveness  metrics  to  make 
procurement-related  decisions,  and  management  should  understand  its  role  in  the 
procurement  process  and  execute  the  process  well  (Garrett  &  Rendon,  2005). 

Another  recommendation  is  for  the  enterprise  to  leverage  some  of  the  more 
mature-rated  groups’  (e.g.,  44!^'''  Combat  Sustainment  Group)  processes  with  the  lower¬ 
rated  marunty  level  units.  The  enterprise  should  also  develop  and  implement  the  use  of 
efliciency  and  effectiveness  metres  and  establish  a  lessons-leamed  and  best-practices 
database  for  the  procurement  planning  process.  These  practices  would  also  be  effective 
in  increasing  the  maturity  level  to  “Optimized”  (Garret  &  Rendon,  2005). 

5.  Contract  Adialolstroiion 

The  enterprise,  based  on  the  results  of  this  CMMM  assessment,  received  a 
maturity  level  of  “Ad-Hoc”  in  the  CM  process  area  of  contract  administration  To  reach 
the  “Basic''  level,  the  enterprise  should  establish  some  basic  contract  management 
processes  and  standards  within  the  organization.  These  basic  processes  should  be 
required  only  on  selected  complex,  critical,  or  high-visibility  contracts,  such  as  contracts 
meeting  certain  dollar  thresholds,  or  contracts  with  certain  customers  Also,  some  formal 
documentation  should  be  developed  tor  these  established  contract  management  processes 
and  standards  (Oaiteti  &  Rendon,  2005). 

Additionally,  the  enterprise  can  leverage  some  of  die  more  mature  groups’  (e.g., 
446*  Combat  Sustainment  Group)  processes,  which  will  facilitate  die  maturation  of  the 
processes  of  die  lower-rated  units.  The  enterprise  should  also  develop  and  implement  die 


57 


use  of  efiiciency  and  effeciiveness  metrics  and  establish  a  lesnons-leamed  and  besi- 
piociM:e«  database  for  the  procuremeni  planning  process  These  practices  would  also  be 
effeciive  in  increasing  the  marurity  level  lo  “Optimized”  (Oarrei  &  Rendon,  2005). 

&  Cootrocf  Closeout 

The  enterprise,  based  on  ihe  results  of  this  CMMM  assessment,  received  a 
matunry  level  of  “Ad-Hoc”  in  the  CM  process  area  of  contract  administration  To  reach 
the  “Basic''  level,  the  enterprise  should  establish  some  basic  contract  management 
processes  and  standards  within  the  organization.  These  basic  processes  should  be 
required  only  on  selected  complex,  critical,  or  high-visibility  contracts,  such  as  contracts 
meeting  certain  dollar  thresholds,  or  contracts  with  certain  customers  Also,  some  formal 
documentation  should  be  developed  tor  these  established  contract  management  processes 
and  standards  (Oaiteti  &  Rendon,  2005). 

Another  recommendation  is  for  the  enterprise  to  leverage  some  of  the  more 
mature-rated  groups’  (e.g.,  44!^'''  Combat  Sustainment  Group)  processes  with  the  lower- 
rated  maninty  level  units.  The  enterprise  should  also  develop  and  implement  the  use  of 
etficiency  and  effectiveness  metrics  and  establish  a  lessons-teamed  and  best-practices 
database  for  the  procurement  planning  process.  These  practices  would  also  be  effective 
in  increasing  the  maturity  level  to  “Optimized”  (Oarrei  &  Rendon,  2005). 

7.  Other  Reconimcndoiioos 

Going  outside  the  OC-ALC.  the  conu^i  management  enterprise  can  solicit  other 
ALC’s  to  benchmark  best  practices  and  determine  how  processes  can  be  improved, 
a.ssuming  the  benchmarked  organization  used  the  CMMM.  As  mentioned  previously,  the 
TWO  oiher  ALCs  wnhm  the  Air  Force  are  located  at  Robbins  AFB,  Georgia  (Wamer- 
Robbins  ALC  (WR-ALC)),  and  Hill  AFB.  Utah  (Ogden  ALC  (OO-ALC)). 
Coincidentally,  ihe  CMMM  is  being  assessed  ai  00-ALC  concurrently  with  this 
assessment  at  the  DC -ALC.  The  OC-ALC  can  get  a  copy  of  the  OO-ALC  research  to 
determine  in  which  areas  the  OO-ALC  is  strong.  By  comparing  the  results  of  iheir 
analyses,  the  two  centers  can  help  each  other  progress  Considering  ihai  both  these  ALCs 


are  comparable  m  size  and  dollars  expended,  these  are  prime  candidates  lo  improve 
contract  management  process  macuriiy. 

Other  susiaiiunent  activities  within  the  DoD  arc  also  good  sources  to  consider  for 
the  OC-ALC  to  compare  contracting  processes.  For  the  Army,  Anniston  Army  Depot  m 
Alabama  has  an  annual  budget  of  SI  IB  and  over  6JOO  employees  (Anniston  Army 
Depot,  20071.  Additionally,  the  Navy  has  three  shipyards  that  perform  logistics  support 
These  are  located  at'  Portsmouth,  Kittery  Marne,  New  Hampshire;  Norfolk  at 
Portsmouth,  Virginia;  and  Puget  Sound  at  Bremerton,  Washington.  Additionally,  two 
Marine  Corps  Logistics  bases  are  located  in  Albany,  New  York,  and  Barstow,  California 
These  may  provide  additional  insight  into  the  contract  management  process  (Navy  Depot 
Maintenance  fact  sheet,  2007). 

E.  LEARNING  ORCAMZATJON  ASSESSMENT  RE.SL'LTS 

This  research  uses  the  Learning  Organization  Assessment  and  related  Learning 
Organization  Assessment  Matrix,  adapted  from  Peter  Kline  and  Bernard  Saunders’  book, 
TeM  Siepsi  to  a  Leanun^  Or^nizaUon  This  tool  was  selected  to  determine  what  learning 
organization  characteristics  each  group  possesses,  and  what  the  groups  that  scored  low 
can  do  to  improve  their  learning  abilities.  Additionally,  this  assessment  gives 
management  an  indication  of  whether  more  needs  to  be  done  to  improve  the  culture  of  its 
workforce,  which  is  especially  cniical  with  the  rate  of  change  in  today's  business 
environment. 

As  listed  in  Chapter  (1,  Kline  and  Saunders’  Ten  Steps  to  a  Learning  Organization 

are;  (I)  Assess  your  learning  culture;  (2)  Promote  the  positive;  (3)  Make  the  workplace 

safe  for  thinking;  (4)  Reward  risk-taking;  (5)  Help  people  become  resources  for  each 

other;  (6)  Put  learning  power  to  work;  (7)  Map  out  the  vision;  (8)  Bring  the  vision  to  life; 

(9)  Connect  the  systems,  and  (10)  Get  the  show  on  the  road.  The  steps  are  defined  below. 

Step  I  Assess  Your  Learning  Culture.  Before  an  organization  can  move 
ahead  m  any  of  the  Ten  Steps  m  the  process,  the  decision-makers  need  to 
be  willing  to  face  the  truth  about  what  the  employees  are  thinking. 
Acknowl^ging  what  ts  working  and  whai  Is  missing  is  ihe  first  step  to 
building  a  creative  and  dynamic  organization  capable  of  revitalizing  itself 
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By  u&ing  ihe  Learning  Organization  Assessment  mairtv,  an  organizatjon 
can  accom[ilish  Step  I  and  begin  iPe  iransformaiion  lo  cbangmg  the 
organization 

Sten  2:  Promote  the  Positive.  This  Step  establishes  a  culture  of  positive 
thinking  The  attitude  of  always  seeing  the  glass  as  half-empty  needs  to 
change  to  seeing  it  as  half-full.  Appreciation  needs  to  replace  the 
debilitating  effects  of  put-downs.  This  step  focuses  on  treating  everyone 
with  dignity  and  respect  at  alt  times.  Until  this  has  been  achieved,  the 
learning  organization  efforts  wilt  remain  an  exercise  in  futility.  A  number 
of  positive  refrain  ing  exercises  are  i  ncluded. 

Step  i  Making  the  Workplace  Sate  tor  Thinking  The  aim  is  to 
encourage  thinking  by  everyone,  which  means  being  receptive  to  the 
resulting  ideas  Too  many  managers  resist  the  flow  of  ideas  from  below  in 
the  organization  rather  than  providing  an  environment  in  which  they  can 
flourish.  A  safe  and  supportive  environment  is  needed  to  encourage 
creativity  and  innovation.  A  number  of  techniques  are  suggested,  such  as 
the  use  of  dialogue  advocated  by  Peter  Senge. 

Sten  4  Reward  Rutk-taking  In  the  competitive  and  volatile  global 
economy,  moderate  risk-taking  is  becoming  a  prerequisite  tor  survival  An 
analogy  is  drawn  with  developments  m  science,  which  have  depended  on 
the  persona)  interaction  between  scieniists  and  the  pursuit  of  new  ideas 
All-important  is  the  management  environment  to  include  signals  and 
anitudes  management  exhibits  towards  nsk-taking  The  rewards  for 
succeeding  need  to  be  reasonably  high,  while  the  penalties  for  a  'failed' 
risk  should  be  low. 

Step  5’  Help  People  Become  Resources  tor  Each  Other  The  point  of  this 
step  is  to  encourage  people  to  see  each  other  as  resources  with  unique 
talents  and  to  harness  these  talents.  Individuals  can  best  contribute  if  their 
skills  are  recognized  and  appreciated.  The  rigid  bureaucratic  structures  of 
many  organizations,  with  iheir  corresponding  '^Ikanizaiion"  and  turf 
wars,  are  a  profound  impediment  to  productivity  and  growth.  The  book 
makes  interesting  observations  on  organizations  being  seen  as  living 
systems  and  operating  best  on  the  "edge  of  chaos"  A  number  of 
techniques  are  suggested  to  help  people  see  each  other  as  resources, 
including  a  '‘multiple  intelligences"  checklist,  which  enables  assessment 
of  each  individual  in  terms  of  seven  ditfereni  types  of  intelligence — 
visual/spatial,  bodily/kinesthetic,  interpersonal,  mu'apersonal,  musical, 
linguistic,  and  logical/mathematical.  The  first  five  steps  have  addressed 
the  basic  assumptions  and  expectations  which  block  development  of  a 
learning  organization. 

Sten  h'  Put  Learning  Power  to  Work  The  book  asserts  that  the  premises 
organizations  need  to  build  on  are  that  “all  people  are  capable  of  imtimiied 
learning,’'  and  "learning  is  not  a  scarce  commodity  that  only  takes  place  in 
a  con^lled  learning  environment."  The  book's  authors  discuss  the 
obstacles  to  learning,  and  there  is  an  outline  of  key  tenets  of  the 
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Iniegraiive  Learning  approach.  Learning  and  wo<k  are  seen  aa  forming  a 
conimuous  loop— learning  coming  ihrough  (he  work  iiself.  The  emphasis 
in  such  a  cycle  is  on  discovery  and  direct  experience.  The  authors  also 
describe  a  Learning  Leader's  model,  which  was  successfully  adopted  by 
Kodak  to  accelerate  organizaiiona)  learning. 

Step  7:  Map  out  the  Vision.  A  shared  vision  is  a  powerful  tool  for 
harnessing  the  different  talents  and  motivations  of  the  individuals  in  the 
enterprise  and  pointing  them  in  the  same  direction  Each  member  of  the 
organization  must  understand  and  believe  this  However,  the  book  warns 
of  the  pitfalls  of  group  interactions — the  collective  (Q  of  the  group  is 
likely  to  be  lower  than  (hat  of  the  individual  with  the  lowest  IQ  in  the 
group  Consensus  is  not  an  effective  way  of  crafting  a  vision;  what  is 
needed  Is  synergy  'The  authors  introduce  group  mind-mapping  as  a  tool 
for  helping  to  achieve  group  synergy. 

Sien  S.  Bring  the  Vision  to  Life.  This  step  is  basically  about  mobilizing 
the  normally  neglected  kmesthetic  intelligence  Kinesthetic  modeling  is 
seen  as  an  effective  technique  for  understanding  how  organizations  wotk, 
how  processes  flow,  how  relationships  develop,  etc.  Another  important 
aspect  of  kinesthetic  modeling  is  awareness  of  body  language.  A  person's 
Body  language  communication  must  be  consistent  with  the  messages  the 
individual  is  trying  to  portray. 

Step  9;  Conniyt  the  Systems  Systems  thinking  was  Peter  Senge's  fifth 
discipline  in  his  book  of  the  same  name.  Systems  thinking  is  global  and 
comprehensive.  On  the  other  hand,  linear  (left-braini  thinking  has  a 
tendency  lo  go  for  the  "quick  fix"  (which  often  becomes  embedded  in  ever 
more  complex  systemsl,  rather  than  seeing  the  overall  global  or  systems 
perspective  (which  tends  to  be  leas  completely  specified  and,  hence, 
requires  righi-bram  as  well  as  left-brain  ihinkingl.  An  approach  to 
developing  the  systems  theory  for  one’s  own  organization  is  outlined  The 
nine  steps  so  ^  collectively  lack  the  uniting  force  that  ties  everythmg 
together. 

Step  10  (let  the  Show  on  the  Road  It  is  (deposed  that  the  organization 
explore  drama  as  a  guiding  metaphor  to  focus  and  energize  its  interna) 
activities  and  its  approach  lo  (he  world  at  large.  The  successful 
organization  is  seen  as  having  a  script  (the  business  plan)  and  a  director 
(tlM  CEO)  to  bring  it  to  life,  gening  the  best  out  of  (he  actors  (the  people 
m  (he  organization).  And  the  play  needs  to  evolve  and  improvise  as 
circumstances  change.  This  gives  an  artisuc  and  creative  dimension  to 
leading  the  enterprise  We  can  envisage  the  evolving  world  where 
“tensions  between  management  and  labor,  between  public  and  pnvate 
sector,  will  give  way  to  a  sense  of  harmony  and  community  that  satisfies 
the  deepest  needs  of  the  whole  commonwealth  and  indeed  for  the  first 
time  fully  defines  the  true  meanmg  of  that  term.'’  (Kline  &  Saunders, 
1993,  pp  239) 
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TtK  Learning  Organization  Assessment  is  compnseil  of  36  quesiKins,  each  with 
five  possible  options  for  the  respondent:  (1)  ■■  Not  at  all,  (2)  ~  To  a  slight  extern,  (3)  ~  To 
a  moderate  extent,  (41  •  To  a  great  extent,  and  (5)  •  To  a  very  great  extent.  After  the 
assessment  is  completed,  one  cen  add  up  all  36  responses  and  divide  by  36,  the  number  of 
statements.  This  provides  an  average  (on  a  scale  of  1-5)  rating  of  how  well  the 
respondent  believes  his  or  her  organization  possesses  the  characteristics  of  a  learning 
organization 

While  this  approach  provides  a  good  overall  impression  of  the  organization's 
learning  ability,  a  more  detailed  analysis  can  be  provided  by  utilizing  the  Learning 
Organization  Assessment  Matrix  as  discussed  in  Chapter  11.  The  Matrix  matches  the  36 
questions  to  the  corresponding  step  in  the  10-step  process  to  determine  which 
characteristic  an  organization  possesses,  or  at  which  Step  the  organization  needs  to  start 
to  become  a  learning  organization.  The  results  suggest  in  which  areas  an  organization  is 
strong  or  weak  and  can  be  used  as  a  yardstick  for  measuring  changes  over  time  (Kline  & 
Saunders,  1993).  Typically  an  organization  believes  it  does  not  need  to  improve;  indeed, 
ic  doesn't  realize  a  simple  tool  like  this  can  provide  keen  insight  and  easy  remedies  to 
improve  its  culture.  'This  is  ever  more  important  and  applicable  to  the  Air  Force  as  it 
downsizes  its  force  and  faces  numerous  civilian  retirements 

The  researchers  will  discuss  the  results  of  the  Learning  Organization  Assessment 
by  each  group  within  the  respective  Wing  (e  g ,  Aircraft  Sustainment  Wing).  The  ASW 
results  of  the  Learning  Organization  Assessment  matrix  are  summarized  below  m  Figure 
12,  while  the  CSW  results  are  summarized  in  Figure  13  Both  results  are  described 
further  in  subsequent  paragraphs.  The  terms  '‘characteristic”  and  “step'’  are  used 
interchangeably  for  analysis. 
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For  th£  121'^  Aircraft  Sustainment  Group,  the  three  characteriittcs  of  a 
learamg  urgaiuzaitun  ibai  were  most  evhibned  ore:  Promoting  ihe  Posiuve,  Safe  Thinking 
and  Rewarduig  Rjsk-taking.  Promoting  the  Positive  uivolves  changing  attitudes  and 
behaviors  of  people  in  the  orgngi?ntioc  to  lenm  to  think  positively.  Seeing  the  glass  os 
half-full  descnbes  the  vision  for  this  step.  The  behavior  of  the  organkation,  both 
iniemnJIy  to  itself  and  externally  and  towards  the  outside  world,  needs  to  become  more 
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positive  and  suppontve.  Safe  Thinking  involves  encouraging  employees  to  pursue  their 
good  ideas  and  promote  individual  creativity  and  innovation  without  fear  of  reprisal 
within  the  organization.  It  challenges  people  to  develop  a  climaie  in  which  all  will  look 
for  ways  to  do  iheirjobs  bener,  in  which  the  attitudes  and  moiivaitons  needed  to  power 
quality  control,  continuous  improvement  and  all  the  other  goals  of  today's  corporations 
are  built  into  everyone’s  behavior  and  expectations.  Rewarding  the  characteristic  of 
“Risk-Taking"  requires  management  to  cultivate  the  art  of  risk  and  to  not  punish  people 
for  trying  new  things.  Without  tnielligeni  risks,  success  becomes  impossible  (Kline  & 
Saunders,  1993).  This  mindset  complements  the  ideas  of  continuous  improvement 
through  innovation  and  will  make  the  organization  more  efficient  as  its  personnel  find 
bener  ways  of  doing  things. 

^  747ih  Aircraft  Sustaiuoxent  Group 

For  the  747'*'  Aircraft  Sustainment  Group,  the  three  charactecistics  of  a 
learning  organization  that  were  most  exhibited  are;  Promoting  the  Positive,  People  as 
Resources,  and  Put  Learning  Power  to  Work.  As  stated  previously.  “Promoting  the 
Positive”  involves  seeing  the  glass  as  half-full.  'The  charactenistic  of  “People  as 
Resources"  involves  encouraging  people  to  see  each  other  as  resources  with  unique 
talents  and  to  harness  these  talents.  Often  individuals  only  have  one  skill  set  needed  to 
complete  a  larger  task,  but  can  enlist  the  aid  of  others  with  complementary  skill  sets  to 
fulfill  the  vision  of  the  organization  Put  Learning  Power  to  Work  involves  taking 
advantage  of  the  work  done  in  Steps  I  through  S  Everyone  is  actually  learning  or 
potentially  learning  for  the  improvement  of  the  organization.  Innovation  and  continuous 
improvement  occur  spontaneously  (Kline  &  Saunders,  1993). 

c.  827ih  Aircraft  Suytainmerxt  Group 

For  ihe  827ih  Aircraft  Sustainment  Group,  the  three  characteristics  of  a 
learning  organization  that  were  most  exhibited  are;  Assessment,  Promoting  the  Positive, 
and  People  as  Resources,  Assessment  involves  taking  a  pulse  of  the  organization  to 
determine  what  is  working  and  what  is  noL  This  happens  by  determining  whai  the 
employees  are  thinking.  'The  L«ammg  Organization  Assessment,  with  corresponding 
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nuiHx.  B  fool  Tor  dcfi^rmbiag  fhi^  very  fhtng.  In  order  to  Promote  the  Posiiive, 
nuncij;emmf  mosi  chanije  ihe  amiudcs  and  behaviors  of  people  in  the  orjjanuaiion  ond 
leech  ibem  to  fbink  posiuvely.  The  cbiiraciensiic  of  People  as  Resources  icvolves 
encouraging  people  lo  see  each  oiber  as  resources  with  imic|ue  ulenis  and  lo  harness 
these  lalenu  (Kline  &  Saunders^  1993).  Miuiy  limes  individuals  gel  suck  working  on  a 
Larger  task,  but  if  they  sought  out  ibe  help  of  oihers,  the  could  become  much  easier 
due  to  more  skill  seu  being  utilised. 

2.  Assessment  Results  for  ibe  Comboi  Susiolnmeni  »'lny 


CSW'l^ftovuSa 


Figure  12.  Loarulny  Oryualulion  Asscssmoni  Results  fur  CSW 
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a. 


44ltih  Comhai Suitainmeni  Group 


For  the  44$'*'  Combat  Sustainment  Group,  the  three  characteristics  of  a 
learning  organization  that  were  most  exhibited  are:  Safe  Thinking,  Rewarding  Risk- 
Taking,  and  People  as  Resources.  Safe  Thinking  involves  encouraging  employees  to 
pursue  their  good  ideas  and  advocate  for  everyone’s  thinking  capacity  within  the 
organization  It  challenges  people  lo  develop  a  climate  in  which  all  will  look  for  ways  to 
do  their  jobs  better,  in  which  the  altitudes  and  motivations  needed  to  power  quality 
control,  continuous  improvement  and  all  the  other  goals  of  today's  corporations  are  built 
into  everyone’s  behavior  and  expectations  Rewarding  Risk-Taking  requires 
management  to  cultivate  the  an  of  nsk-taking  and  to  not  punish  people  for  trying  new 
things.  Without  intelligent  risks  success  becomes  impossible.  This  mindset  complements 
the  ideas  of  continuous  improvement  through  innovation  and  will  make  the  organization 
more  efficient  as  its  personnel  find  better  ways  of  doing  things  The  Step  People  as 
Resources  involves  seeing  individuals  as  resources  and  not  job  descriptions  (Kline  & 
Saunders,  1993)  Often  individuals  only  have  one  skill  set  needed  to  complete  a  larger 
task,  but  can  enlist  the  aid  of  others  with  complementary  skill  sets  to  fulfill  the  vision  of 
the  organization. 

&  74Slh  Comhut  Su  ^ulnment  Group 

For  the  74$'*'  Combat  Sustainment  Group,  the  three  characteristics  of  a 
learning  organization  that  were  most  exhibited  are'  Promote  ihe  Positive,  Safe  Thinking, 
and  Rewarding  Risk-taking  In  order  to  Promote  the  Positive,  managemeni  must  change 
the  attitudes  and  behaviors  of  people  in  the  organizauon  and  teach  them  to  think 
positively.  Safe  Thinking  involves  encouraging  employees  to  pursue  their  good  ideas 
and  promote  individual  creativity  and  innovation  without  fear  of  reprisal  within  the 
organization  It  challenges  people  to  develop  a  climate  in  which  all  will  look  for  ways  to 
do  (heir  jobs  better,  in  which  the  aiumdes  and  motivations  needed  to  power  quality 
conuxil,  continuous  improvemeni  and  all  the  other  goals  of  today's  corporations  are  built 
into  everyone's  behavior  and  expectations  Rewarding  Risk-Taking  requires 
management  to  cultivate  the  an  of  nsk-taking  and  to  not  punish  people  for  trying  new 
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ihings.  WictwiJt  inielligeni  risks,  success  becomes  impossibie  (Kline  &  Saunders,  1993) 
This  mmdsei  complemenis  die  ideas  of  continuous  itnprovemeni  through  innovation  and 
will  make  the  organization  more  efRcient  as  its  personnel  find  better  ways  of  doing 
things. 

c.  C/m/>a/  Su  Ua/nmen/  Group 

For  the  S48‘*'  Combat  Sustainment  Group,  the  three  characteristics  of  a 
learning  organization  that  were  most  exhibited  are'  People  as  Resources,  Put  Learning 
Power  to  Wort!  and  Get  the  Show  on  the  Road  The  Step  People  as  Resources  involves 
seeing  individuals  as  resources  and  not  Job  descriptions.  Often  individuals  only  have  one 
skill  set  needed  to  complete  a  larger  task,  but  can  enlist  the  aid  of  others  with 
complementary  ^ill  sets  to  fulfill  the  vision  of  the  organization.  Put  Learning  Power  to 
Work  involves  taking  advantage  of  die  work  done  in  Steps  one  through  five.  Everyone  is 
actually  learning  or  potentially  learning  for  the  improvement  of  the  organization 
Innovation  and  continuous  improvement  occur  spontaneously.  Oetiing  the  Show  on  die 
Road  takes  advantage  of  the  work  done  in  Steps  one  through  mne.  Here,  die  organization 
expenencea  most  clearly  die  overlying  force  that  ties  everything  together,  as  well  as  die 
overlapping  energy  between  the  organization  and  life  itself.  The  goal  is  to  internalize  all 
the  organization  has  been  learning,  and  express  it  through  die  particular  forms  of  action 
which  have  been  chosen  to  direct  the  life  energy  (Kline  &  Saunders,  1993). 

F.  LEARNINC;  ORCJANIZATIGN  ASSESSMENT  RESULTS  AT  THE 

ENTERPRISE  LEVEL 

Since  the  Ten  Steps  build  upon  each  other,  having  stronger  characteristics  in  a 
later  step  will  not  do  much  good  if  the  organization  has  weaker  characteristics  in  an 
earlier  step.  The  overall  results  of  the  Learning  Organization  Assessment  for  die 
enterprise  were  fairly  consistent  across  all  Ten  Steps  The  enterprise  received  an  average 
rating*  across  die  Seven  Steps  consisting  of;  AssessmenL  Promote  the  Positive,  Safe 


*  The  I^afniAg  OtfaDizaiiofi  Ais»9ft«fii  uses  e  scale  of  1*5  Tbe  rcsMudeni  scores  tiiibcr  uiui  on 
oscli  of  itic  to  clieracterisiKS.  Dividing  aJJ  Uk  quesuona  for  ifie  relaiing  sicp  by  ihei  same  number  of 
quesiions  provides  e  numervat  rating  for  iliai  pantculai  siep  Average  rating  is  usuatly  around  2  5. 
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Thinkmg,  Rj&k-Taking,  People  as  Re&ources,  Learning  Power,  and  Get  ihe  Show  on  the 
Road.  Tliis  resuli  dKtaiee  that  cite  enierpnse  is  doing  welt  in  these  areas;  however,  the 
retnejning  areas  can  be  improved 

The  three  characteristics  not  exhibited  as  much  as  the  other  seven  characteristics 
(based  on  their  low  score!  at  the  DC-ALC  were:  Step  7.  Map  the  Vision,  Step  8,  Mode) 
the  Vision,  and  Step  9,  Systems  Thinking.  The  enterprise  maintained  a  fairly  constant 
level  for  the  first  Six  steps.  It  also  rated  will  m  Step  10  Yet.  the  organization's  abilities 
began  to  decline  in  Step  7.  The  following  paragraphs  will  discuss  some  methods  for 
improving  Steps  7  through  9  to  illustrate  some  of  the  valuable  tools  the  Ten  Steps  can 
bring  to  a  Learning  Organization  like  the  DC-ALC. 

G.  (MPROVINC;  LEARNING  OR(;aNIZATION  CAPABILITY 

Step  1:  Map  out  the  Vision  A  shared  vision  created  through  synergy  (rather  than 
consensus)  iniegraies  each  individual’s  contribution  into  a  new,  much  richer  possibility 
than  an  individual  or  small  group  could  have  achieved  alone.  The  vision  must  belong  to 
everyone  (Kline  &  Saunders,  1993). 

A  recommendation  for  the  OC-ALC  Directorate  of  Conu^ting  to  Map  out  the 
Vision  IS  to  do  a  Cnoup  Mind  Mapping  exercise.  Group  Mind  Mapping,  as  mentioned 
previously,  is  a  powerful  graphic  tool  which  enables  members  of  the  organization  to 
achieve  a  shared  vision.  It  derives  its  strength  from  its  connection  to  visual  thinking  and 
ftom  the  cooperative  process  which  creates  it.  Many  people  learn  visually,  so  they  can 
clearly  understand  a  Mind  Map  because  it  represents,  through  visual  symbolism,  ihe 
relationships  between  ideas,  projects,  goals  and  so  on  The  mam  idea  is  located  centrally, 
m  the  form  of  a  ptcrure,  symbol,  or  in  words.  Various  lines  (each  with  its  own  name) 
branch  out  of  ihe  main  idea.  They  depict  one  possible  arrangemeni  of  the 
interrelationship  among  ideas  (Kline  &  Saunders,  1993). 

For  the  OC-ALC,  a  scenario  could  involve  the  ALC  getting  ready  to  initiate  a 
source  selection  for  the  sustainment  of  the  B-S2  program  In  this  example,  a  group  of 
individuals  (who  work  on  this  contract)  get  together  to  map  out  their  primary  objective 
(e.g.,  operational  availability).  This  objective  becomes  the  centerpiece  of  the  Mind 
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Mapping  exercise  ajid  is  where  ail  related  acdvides  must  connect.  Although  ihis  process 
is  similar  lo  bratnsiormmg,  it  lakes  (his  exercise  a  step  further  by  defining  relationships 
between  ideas  central  to  all  key  parties. 

Step  S'  Bnng  (he  Vision  to  Life.  Kline  and  Saunders  introduce  Kinesthetic 
Modeling  as  a  tool  to  bringing  (he  vision  (o  life.  As  we  bnng  our  physical  actions  more 
fully  m  line  with  our  creative  thought  processes,  we  begin  to  enjoy  many  things  (hat  used 
to  seem  like  hard  work  Once  a  vision  is  agreed  upon,  an  organization  should  act  it  out 
Kinesiheiically.  This  usually  involves  a  person  standing  tn  the  middle  of  the  room 
representing  some  idea  with  (he  rest  of  (he  people  representing  other  aspects  of  that  idea 
Usually,  the  process  is  used  to  illustrate  how  an  organization  sees  itself  currently,  and 
then  how  (he  organization  sees  itself  optimally.  This  tool  helps  people  internalize  the 
relationships  and  nuances  endemic  of  their  vision  and  make  it  more  robust,  thus  giving 
the  organization  more  clear  direction  (Kline  &  Saunders,  1993) 

A  recommendation  for  (he  OC-ALC  Directorate  of  Contracting  to  Bnng  the 
Vision  to  Life  is  (o  partake  m  kinesthetic  modeling.  To  continue  in  our  previous  example 
(sustainment  contract  tor  a  B-S2L  all  the  individuals,  including  functional  experts  (eg. 
finance)  stand  in  the  middle  of  the  room  representing  their  respective  area  Each  function 
(i.e.,  personK  laJies  turns  by  taking  a  step  forward  and  stating  their  roles.  If  (here  is  a 
correlation  between  two  functions  (i.e  ,  persons),  the  related  functions  shake  hands,  lock 
elbows,  etc.,  to  represent  a  relationship  between  the  two  persons  or  tasks.  An  example  of 
related  functions  could  be  (he  connection  between  the  contracting  organization  and 
finance  organization  when  CM  personnel  perform  an  availability  of  funds  determination 
Finally,  one  person  acts  out  the  role  of  (he  application  moving  through  (he  system. 

Step  9:  Connect  the  Systems.  This  step  connects  (he  thought  processes  behind  the 
acdviiKS  in  Steps  7  and  $  by  making  the  organization  more  fully  aware  of  the  power  and 
relevance  of  systems  thinking  Ultimately,  everyone  needs  to  understand  how  the  entire 
organization  works,  so  (hat  if  one  component  breaks  down,  an  individual  will  recognize 
what  process  or  action  needs  to  be  done  to  have  that  component  fixed.  Exercises  to 
develop  these  skills  include  mentally  visiting  a  place  in  your  house  and  countmg  the 
number  of  a  certain  ob;ecL 
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Stx  gutdeposis  tor  building  an  organizaiion’a  own  systems  theory  include' 

1 )  Memory  ••  Good  systems  keep  track  of  themselves 

2)  Purpose  Purpose  of  each  system  must  be  defined. 

3)  Rules  •  Aiticulate  ihe  rules  according  to  which  a  system  operates 

4)  Continuous  Improvement  -  Keep  revising  the  rules  of  the  system  to 

continuously  improve  operations. 

3)  Feedback  -  Systems  may  need  monitoring  and  regulating. 

6)  Human  behavior  is  pan  of  the  system  ••  Good  systems  encourage  people  to  act 

in  the  most  positive  and  effective  ways. 

Using  these  tools  will  help  create  a  systems-ihinking  organization  (Kline  &  Saunders, 
1993) 

A  recommendation  for  the  OC-ALC  Directorate  of  Contracting  to  Connect  the 
Systems  is  to  encourage  mental  modeling.  The  OC-ALC  could  perform  this  exercise  at 
staff  meetings.  For  instance,  eveiyone  should  close  their  eyes  and  mentally  visualize  how 
many  organizations  depend  on  them  for  mission  success.  The  mental  model  task  could 
change  from  week  to  week,  and  if  there  are  any  concerns  or  troubles  with  this  drill,  the 
group  could  go  back  to  kinesthetic  modeling  to  fully  understand  all  the  relationships 
within  the  mental  topic  of  the  day  This  exercise  allows  people  to  be  more  aware  of  the 
big  picture  and  how  their  work  impacts  the  larger  organization. 

While  this  section  showcased  some  of  the  tools  displayed  in  the  Ten  Steps,  for 
best  results,  all  Steps  need  to  be  completed  chronologically.  In  other  words,  the  OC-ALC 
needs  to  work  through  the  entire  Ten  Steps,  beginning  at  Step  one.  Assessment,  and 
working  ail  the  way  through  to  Step  10,  Getting  the  Show  on  the  Road.  By  Ibllowing 
these  steps,  the  OC-ALC  will  improve  its  culture  and  progress  towards  being  a  learning 
organization  that  is  fully  ready  to  embrace  change  and  adapt  to  new  situations.  With  this 
new  culture,  the  void  created  by  the  loss  of  reiiremeni -eligible  employees  and  ihe 
associated  loss  in  corporate  knowledge  can  be  tilled  with  younger,  innovative  employees. 
These  new  employee  accessions  will  help  the  OC-ALC  Inmate  new  ways  of  doing 
business  which  will  help  bolster  conimual  process  improvemeni. 
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El.  CORRELATION  BETWEEN  CMMM  AND  LEARNING 

ORGANIZATION  ASSESSMENT 

WtKn  comparing  ihe  resulis  of  the  CMMM  and  the  Learning  Organizaiion 
A&se^smeni,  the  researchers  made  a  few  observations  The  group  that  was  rated  ihe 
highest  for  contract  maniriry  was  not  rated  the  highest  for  teaming  organization 
assessment  characteristics  Similarly,  the  group  that  was  assessed  as  having  the  least 
mature  contract  processes  was  not  assessed  as  having  the  lowest  learning  organization 
characteristics.  There  appears  to  be  no  other  correlation  between  the  maniriry  of 
conu^ting  processes  and  the  learning  organization  characteristics  within  that 
organization 

However,  on  a  macro  level,  there  does  appear  to  be  a  relationship  between  the  two 
models.  Once  an  organization  reaches  the  CM  maturity  level  of  *  •Optimized"  and  has 
implemented  all  of  its  best  practices,  it  is  successful  However,  without  continuous 
process  improvement,  an  organization's  CM  process  maturity  level  might  only  be 
temporary.  Through  the  Ten-step  process,  an  innovative,  continuous  process- 
improvement  culture  will  emerge  and  not  be  satisfied  with  that  short-term  success.  'Those 
individuals  will  continually  seek  out  other  best  practices  and  maintain  the  “Optimized" 
level  for  a  much  longer  period  of  time.  It  is  the  culture  developed  by  the  Ten-siep 
process  that  enables  (he  organization  to  have  greater  long-term  success.  Thus,  the 
organizational  learning  culture  that  is  developed  through  the  Ten-step  process  is  (he  same 
cuUure  thac  will  maintain  the  “Optimized"  maturity  level. 

It  should  be  noted  that  the  three  steps  discussed  in  the  Improving  Learning 
Organization  Capability  section;  Step  7,  Map  the  Vision,  Step  S,  Model  the  Vision,  and 
Step  9,  Systems  Thinking,  are  all  related  to  team  building  and  team  (raining  within  the 
OC-ALC  Directorate.  Team  building  and  team  training  are  critical  to  an  organization's 
CM  processes.  As  stated  in  FAR  1.102-3— Acquisition  Team,  “by  identifying  the  team 
members  in  this  manner  (beginning  with  the  customer  and  ending  with  the  contractorK 
teamwork,  unity  of  purpose,  and  open  communication  among  (he  members  of  the  Team 
in  sharing  the  vision  and  achieving  the  goal  of  the  System  are  encouraged."  The  above 
three  Steps  can  greatly  enhance  the  DC-ALC  Directorate’s  teamwork,  unity  of  purpose 

and  open  communications  (as  discussed  in  1 .102-3). 
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Boih  modeli  uitliie  orsani2a(ion  ass«^meni&  ihai  can  be  used  as  yardsticks  as 
managers  periodically  revisit  die  enterpnse  to  determine  what  progress  is  or  is  noi  being 
made.  In  the  DoD,  with  many  military  personnel  coniinjously  rotating  in  and  out  of 
positions,  these  tools  prove  their  worth.  This  is  especially  true  when  a  new  commander 
arrives  on  scene  and  wants  to  determine  the  state  of  his/her  organization  to  understand 
what  steps  need  to  be  taken  to  succeed  Additionally,  both  models  offer  suggestions  for 
improvement,  a.ssuming  there  are  any  areas  of  the  organization  rei^uiring  it.  Specific 
criteria  are  utilized  in  each  maturity-level  rating  so  an  organization  can  see  what  it  needs 
to  reach  the  next  level,  and  which  Steps  of  the  Ten-step  process  an  organization  has 
achieved  to  determine  where  it  can  begin  to  improve. 

t.  SUMMARY 

This  chapter  discussed  the  methodology  for  selecting  appropriate  questionnaire 
participants.  Next,  the  researchers  included  a  summary  of  the  findings  and  results  of  the 
CMMM  assessment  tool  and  the  Learning  Organization  Assessment.  The  researchers 
analyzed  these  models  and  provided  recommendations  at  the  end  of  each  section  on  how 
to  improve  in  those  areas  Additionally,  the  CMMM  and  Learning  Organization 
Assessment  results  were  compared  to  determine  any  possible  correlations  between  the 
OC-ALC’s  CM  process  maTunty  and  which  Learning  Organization  Assessment 
characteristics  it  possesses  Chapter  V  will  cover  a  summary  of  the  research  by 
answering  the  questions  from  Chapter  1.  It  wilt  also  provide  a  conclusion  to  what  the 
researchers  learned  in  conducting  this  research  and  further  actiotv'research  areas  of  study 
in  these  and  related  areas.  In  this  way,  the  researchers  hope  to  help  organizations  grow 
and  evolve  into  world-class  organizations. 
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V.  St  MM  AR  V,  CO^CL  U  SlON,  K  U  R I H  E  R  AC  I  lOlN  /RE  S  E  ARCH 


A.  INTRODUCTION 

TtK  following  chapter  will  cover  a  summary  of  ihe  CMMM  and  Learning 
Orgamzaiion  Assessment  results,  concomitantly  answering  research  questions  posed 
earlier  In  Chapter  I  Addmonally,  this  chapter  will  provide  a  conclusion  of  lessons 
learned  while  conducting  this  research  and  also  suggest  further  actlomresearch  areas. 
Through  increased  analysis  m  related  areas,  the  OC-ALC  can  continue  to  grow  and 
evolve  into  a  world-class  organization. 

B.  SUMMARY 

The  purpose  of  this  study  was  to  assess  the  OC-ALC  s  contract  management 
processes  and  procedures,  as  well  as  to  assess  its  learning  organization  charactensdcs,  in 
order  lo  assist  the  ALC  in  maintaining  competitiveness.  The  study  was  completed 
through  the  use  of  the  CMMAT  and  Learning  Organization  Assessment  questionnaire 
vehicles,  which  provide  a  conceptual  dameworiL  The  assessments  provide  a  baseline, 
with  regard  lo  CM  maturity,  as  well  as  idendly  areas  of  organizational  learning  that  could 
need  addiiional  attention. 

Both  of  the  assessments  set  a  baseline  for  the  OC-ALC  with  regard  to  contract 
management  maiuniy  and  learning  organization  characteristics  They  also  identity  areas 
for  further  improvement,  including  examining  other  ALCs  within  the  USAF  or, 
potentially.  Army  and  Marine  Corps  depots.  Results  show  that  based  on  this  CMM 
assessment,  ihe  OC-ALC ’s  maturity  level  is  categorized  as  '‘Basic”  in  the  CM  key 
process  area  of  Procurement  Planning.  They  received  a  “Strucrured''  rating  in  the  CM 
key  process  areas  of  Solicitation  Planning,  Solicitation  and  Source  Selection.  Finally,  the 
OC-ALC  received  an  "Ad-Moc''  rating  in  the  areas  of  Contract  Administration  and 
Contract  Closeout  The  lower  maturity  levels  may  be  skewed  downward  due  to  one  group 
answering  two  entire  areas  with  "Don't  Knows." 
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The  ovefali  results  of  the  L«emmg  Organuaiion  Amassment  for  ihe  enterprise 
were  fatrly  consistent,  with  the  following  three  steps  indicating  the  lowest  characteristics 
ofe  learning  organi2ation;  Step  7,  Map  the  Vision,  Step  S,  Model  the  Vision,  and  Step  9. 
Systems  Thinking  This  indicates  that  the  OC-ALC  needs  to  work  through  the  entire  Ten 
Steps,  beginning  at  Step  one,  Assessment,  and  working  alt  the  way  through  to  Step  10. 
Getting  the  Show  on  the  Road  By  following  these  steps,  the  OC-ALC  will  improve  its 
culriire  and  will  progress  toward  becoming  a  learning  organization  that  is  fully  ready  to 
embrace  change  and  adapt  to  new  situations.  With  this  new  culture,  the  void  in  corporate 
knowledge  can  be  filled  with  younger,  innovative  employees  that  continue  to  think  of 
new  ways  of  doing  things  and  always  focus  on  improvement 

C.  CONCLUSION 

The  following  paragraphs  provide  answers  to  the  research  questions  posed  in 
Chapter  1.  Additionally,  this  section  will  provide  enterprise-level  recommendations  that 
are  supported  by  the  CMMM  and  the  book  Ten  Steps  lu  a  Learning  Orgunizatio"  wntien 
by  Peter  Kline  and  Bernard  Saunders. 

I .  Enterprlse*wlde  Reconinieiidotloos 

A  recommendation  for  the  enterprise  is  to  leverage  some  of  the  more  mature-rated 
groups’  (e.g.  dhs"*  Combat  Sustainment  Groupl  processes  and  incorporate  them  in  the 
lower-rated  maturity  level  units.  The  enterprise  should  also  develop  and  implement  the 
use  of  efHciency  and  effectiveness  metrics  and  establish  a  leaons-leamed  and  best- 
practices  database  for  the  procurement  planning  process  These  practices  would  also  be 
effective  in  increasing  the  maturity  level  to  'Clpiimized”  (Garret  &  Rendon,  2005). 

Going  outside  the  OC-ALC.  the  contract  management  enterprise  can  solicit  other 

ALCs  to  benchmark  best  practices  and  determine  how  processes  can  be  improved. 

a.ssuming  the  benchmarked  organization  used  the  CMMM  The  two  other  ALCs  within 

the  Air  Force  are  located  Robbins  AFB,  Georgia  (Wamer-Robbins  ALC  (WR-ALC)). 

and  Hill  AFB.  Utah  (Ogden  ALC  (OO-ALC))  Coincidentally,  the  CMMM  is  currently 

being  assessed  at  OO-ALC  at  the  lime  of  this  writing.  The  OC-ALC  can  get  a  copy  of 

the  OO-ALC  research  to  determine  in  which  areas  the  OO-ALC  is  strong  and  how  the 
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TWO  ceniers  can  eoch  other.  Considermg  That  boih  ALCs  are  com^iarable  m  size  and 
dollars  expended,  these  are  prime  candidates  to  improve  CM  process  maniniy. 

Other  susrammeni  activities  within  the  DoD  are  also  good  sources  lo  consider. 
For  the  Army,  Anniston  Army  E>epoc  in  Alabama  has  an  annual  budget  of  Sl.lB  and  over 
6500  employees  (Anniston  Army  Depot,  2007).  Addriionally,  the  Navy  has  Three 
shipyards  That  perform  logistics  support  These  are  located  at:  PonsmoutJv  Krtiery  Maine, 
New  Hampshire;  Norfolk  ai  Portsmouih,  Virginia,  and  Puget  Sound  at  Bremerton, 
Washington  Additionally,  two  Marine  Corps  Logisiics  bases  locaied  in  Albany,  New 
York,  and  Barstow,  California,  may  provide  addiiional  insighi  into  the  contract 
management  process  (Navy  Depot  Mainienance  fact  sheei,  2007). 

The  overall  resulis  of  The  Learning  Organuation  Assessment  for  The  enierpnse 
indicates  that  The  OC-ALC  needs  to  work  Through  the  eniire  Ten  Steps,  beginning  ai  Step 
I.  Aaessmeni,  and  proceeding  all  the  way  Through  ro  Step  10,  (ieriing  the  Show  on  the 
Road.  By  following  these  steps,  the  DC-ALC  will  improve  its  culture  Soon,  it  will  have 
a  learning  organization  that  is  fully  ready  lo  embrace  change  and  adapt  lo  new  situations 
With  This  new  culture.  The  void  created  by  “corporaie  knowledge”  retiremeni  can  be  filled 
with  younger,  innovative  employees  ihai  continue  to  think  of  new  ways  of  doing  things 
and  always  focus  on  improvemenr. 

To  improve  on  Steps  7-9  (Step  7,  Map  the  Vision,  Siep  S,  Model  the  Vision,  and 
Step  9.  Systems  Thinking),  the  OC-ALC  may  consider  implementing  Group  Mind 
Mapping,  Kinesthetic  modeling,  and  menial  modeling.  As  described  above,  Oroup  Mind 
Mapping  derives  irs  strength  from  us  focus  on  visual  thinking  and  ftom  the  cooperaiive 
process  which  creates  it.  A  scenario  for  Oroup  Mind  Mapping  could  involve  the  OC- 
ALC  gening  ready  to  initiate  a  source  selection  for  the  susiainmeni  of  the  B-S2  program 
In  this  situation,  a  group  of  individuals  (who  work  on  this  coniraci)  get  together  to  map 
OUT  their  primary  objective  (e.g.,  operational  availablliry).  This  ob^ciive  becomes  the 
centerpiece  of  the  Mind  Mapping  exercise  and  is  where  all  related  activities  must 
connect. 

Kinesthetic  modeling;  to  continue  in  our  previous  example  (sustainment  contract 
for  a  B-52),  all  the  individuals,  including  funciiona)  experts  (e.g.,  finance)  stand  in  the 
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middle  of  the  room  represenitng  (heir  respective  area.  Each  tunciion  (i.e .  person),  lakes 
rums  by  taking  a  step  forward  and  stating  its  role.  If  there  is  a  correlation  between  two 
fimciions  (i  e.,  peftons),  the  related  functions  shake  hands,  lock  elbows,  etc  to  illustrate  a 
relationship  between  (he  two  persons  or  tasks.  An  example  of  related  functions  could  be 
the  connection  between  contracting  and  finance  when  CM  personnel  perform  an 
availability  of  funds  determination.  Finally,  one  person  acts  out  the  role  of  the 
application  moving  through  the  system. 

Mental  modeling:  the  DC-ALC  could  perform  this  exercise  at  staff  meetings. 
Management  urges  everyone  to  close  his/her  eyes  and  mentally  visualize  how  many 
organizations  depend  on  him/her  for  mission  success.  The  menial  model  task  could 
change  from  week  to  week,  and  if  there  are  any  concerns  or  troubles  with  this  drill,  the 
group  could  go  back  to  kinesthetic  modeling  to  fully  understand  all  the  relationships 
within  the  mental  topic  of  the  day  This  exercise  allows  people  to  be  more  aware  of  the 
big  picture  and  how  their  work  impacts  the  larger  organization  (Kline  &  Saunders,  1993). 

2.  Research  Questions  Answered 

In  addition  to  determining  the  OC-ALC’s  CM  maturity  and  learning  organization 
characteristics,  the  study  also  addressed  the  following  research  questions; 

1  How  can  the  CMMM  and  knowledge  management  tools  assist  the  OC- 
ALC's  contract  management  division'^ 

2  How  mature  are  the  OC-ALC’s  contract  procesnes  and  procedures'^ 

3  What  are  the  OC-ALC’s  organizational  learning  characienstics? 

4  How  much  of  a  correlation  is  there  between  the  ALC's  contract 
management  maturity  and  its  organizational  learning  characteristics? 

5  To  what  degree  can  the  OC-ALC  leverage  its  knowledge  management  in 
other  DoD  initiatives? 

6  Are  there  areas  for  improvement  based  on  these  h’ameworks,  and 
specifically,  what  actions  can  the  ALC  take  to  improve*^ 

Research  Question  1:  How  can  (he  CMMM  and  knowledge  management  (ools 
a.ssis(  (he  OC- ALC's  contract  management  division?  The  CMMM  and  knowledge 
management  tools  provide  a  snapshot  in  time,  or  baseline,  on  which  the  OC-ALC  should 
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build.  TtKse  baielines  will  prove  u&eful  in  adhering  (o  ihe  new  guidelines  set  fonh  m  ihe 
DoD  Human  Capital  Strategic  Plan,  which  is  to  be  implemented  soon.  These  assessments 
provide  the  OC-ALC's  contract  management  divisions  keen  insight  into  what  is  worttmg 
and  what  is  not,  as  well  as  recommendations  to  improve 

Research  Question  2'  How  mature  are  the  OC-ALC’s  contract  processes  and 
procedures?  Study  results  reveal  that  the  OC-ALC's  contract  maturity  level  Is  *'Dasic"  in 
the  CM  key  process  area  of  Procurement  Planning.  The  organization  received  a 
“Structured’'  rating  in  the  process  areas  of  Solicitation  Planning,  Solicitation  and  Source 
Selection.  Finally,  the  OC-ALC  received  an  “Ad-Hoc”  rating  in  Contract  Administration 
and  Contract  Closeout. 

Research  Question  3'  What  are  the  OC-ALC’s  organizational  learning 
characteristics?  The  overall  results  of  (he  Learning  Organization  Assessment  for  the 
enterprise  were  fairly  consistent.  The  enterprise  received  an  average  rating^  across  the 
Seven  Steps  of  Assessment,  Promote  the  Positive,  Safe  Thinking,  Risk-Taking,  People 
as  Resources,  Learning  Power,  and  Get  the  Show  on  the  Road.  This  result  dictates  that 
the  enterprise  is  doing  well  in  these  areas;  however,  the  remaining  areas  can  be  improved 

Research  Question  4'  How  much  of  a  correlation  is  there  between  the  ALC's 
conu^i  management  marurity  and  its  organizauonal  learning  characteristics'^  There 
appears  to  be  no  correlation  between  the  marunty  of  contracting  processes  and  the 
learning  organization  characteristics  within  (hat  organization. 

On  a  macro  level,  there  does  appear  to  be  a  relationship  between  the  two  models, 
it  not  their  short-term  results.  Once  an  organization  reaches  the  CM  process  level  of 
“Optimized"  and  has  implemented  all  of  its  best  practices,  it  is  successful.  Through  the 
Ten  Steps  process,  an  innovative,  continuous  process-improvement  culture  will  emerge 
Short-term  success  will  not  satisly  such  a  culture.  Members  of  the  organization  will 
coniinually  seek  out  other  best  practices  and  strive  to  maintain  the  “Optimized''  level  for 


^  The  Learning  Organization  Asscasment  uses  a  scale  of  1-5,  wiiti  v^hicli  the  rcqiondent  rates  his  or 
her  orgatiizaiion's  eliatacwrisiics  of  a  Icsming  orgsoizaiion.  By  dividiog  all  itie  <iiKsiuns  for  Uk  relating 
9cp  by  ibai  same  number  of  qumuns.  ihe  researchers  ean  arrive  ai  a  numcncal  rating  for  flat  pamcular 
sirp  Avenge  taiing  is  defined  as  somewbereterween  ihe  2-3  raoge 
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d  much  longer  period  of  time.  Becau&e  of  (his,  the  CMMM  and  Learning  Orgonizoiion 
Assessment  models  complement  each  other. 

Both  models  utilize  organization  assessments  (hat  con  be  used  as  yardsticks.  With 
these,  management  can  periodically  revisit  its  organization  to  determine  what  process  is 
or  is  not  being  made.  Additionally,  both  models  offer  suggestions  for  tmprovemeni, 
assuming  there  are  any  areas  of  the  organization  that  require  it.  SpeciHc  cntena  are 
utilized  in  each  maturity -level  rating.  Thus,  an  organization  can  see  what  it  needs  to 
arrive  at  the  next  level  and  which  Steps  of  the  Ten-step  process  it  has  achieved  to 
determine  where  to  improve. 

Research  Question  5;  To  what  degree  can  the  OC-ALC  leverage  its  knowledge 
management  in  other  DoD  initiatives?  The  OC-ALC  can  leverage  its  knowledge 
management  in  preparation  of  the  EkiD  Human  Capital  Strategic  Plan  In  this  initiative, 
employees  will  complete  a  Contracting  Competency  model,  which  takes  about  an  hour  to 
complete.  Once  a  supervisor  has  identified  areas  in  which  the  subordinate  needs  to 
improve,  they  get  together  to  map  out  a  strategic  plan  to  fill  that  knowledge  gap.  The 
results  from  the  Learning  Organization  Assessment  will  assist  the  OC-ALC  In  improving 
Its  culture  so  that  the  implementation  of  the  DoD  Human  Capita)  Strategic  Plan  efforts 
will  be  much  more  successful. 

Research  Question  6'  Are  there  areas  for  improvement  based  on  these 
frameworks,  and  specifically,  what  actions  can  the  ALC  take  to  improve?  Based  on  the 
survey  responses,  the  OC-ALC  needs  to  provide  more  education  on  CM  key  process 
areas  of  Contract  Administration  and  Contract  Closeout  This  education  would  enable 
the  responder  to  better  answer  the  question  in  future  applications  of  the  CMMM 
Granted,  some  organizations  may  not  deal  specifically  with  any  one  CM  key  process 
area;  however,  employees  should  be  aware  of  the  process  When  a  workforce  continues 
to  get  smaller,  all  employees  need  to  be  flexible  and  understand  all  the  key  process  areas 
because  they  may  be  called  upon  to  do  new  tasks  on  short  notice.  Recommendations  for 
addiiiona)  analysis  and  general  improvement  techniques  are  provided  in  the  next  section. 
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D.  FURTHER  ACTION/RESEARCH 

TtK  OC-ALC,  like  any  successful  enierpnse,  has  (he  objective  of  conimually 
improving  ns  business  processes.  Ii  must  especialty  ensure  retention  of  corporate 
knowledge  (o  coimieraci  pending  civil  service  reuremenis  This  study  recommends  thai 
the  following  additional  research  be  conducted  by  the  OC-ALC  and'or  other  researchers; 


1  Utilize  the  enhanced  Learning  Organizational  Assessment  in  Kline  and 
Saunder’s  The  Ten  Sleps  to  a  Leantin^  Or^anizahon.  This  more 
comprehensive  assessment  provides  a  clearer  picture  of  the  current  state  of 
an  organization  in  order  to  make  (he  development  of  specific  learning 
strategies  more  efTieient  and  effective.  The  enhanced  Assessment  has  68 
statements  and  allows  users  to  cross-reference  each  of  the  statements  with 
the  Ten  Steps.  It  provides  a  clearer  starting  point,  and  a  more  complete 
map  to  needed  change.  (Kline  &  Saunders,  19931 

2  Utilize  the  results  of  (he  CMMAT  and  Learning  Organization  Assessment 
to  develop  metrics  champions  within  the  ALCs.  Since  the  CMMAT  was 
already  applied  to  Hill  AFB  (00-ALC),  the  individuals  responsible  for 
maintaining  these  standards  at  each  ALC  should  maintain  a  dialog  to  keep 
the  other  informed  of  best  practices. 

3  Fund  additional  research  through  NPS  or  another  entity  to  further  develop 
the  Learning  Organization  Assessment  tool  used  for  this  study  at  Robins 
AFB,  OA  (WR-ALCK  a  Test  &  Evaluation  Center,  Army  and  Marine 
Corps  Depots,  Product  Centers,  and  other  organizations  that  could  benetii 
ftom  this  research. 

4  Fund  research  to  revisit  organizations  where  the  model  was  already 
applied,  and  determine  if  the  organization  has  improved,  and  to  what 
extent,  since  the  previous  research  was  applied. 


79 


THIS  PAGE  INTENTIONALLY  LEFT  BLANK 


RO 


A¥PK.^DlX  A.  CMMM  RESULTS 


1 

2 

3 

4 

5 

6 

Summary 

Prodaeinert 

Solicitation 

SoicitatKin 

Soiaca 

ContiacI 

Contract 

Planrl>g 

Piarmng 

Seiection 

Acftriinist  ration 

Closeout 

Total  727 
ACSG 

Total  747 

3.53333333 

3.4 

3  3866667 

3  533333 

3  366665667 

3  25667 

ACSG 

Total  827 

3.33333333 

3.2 

3  3333333 

3.8 

26 

2  73333 

ACSG 

2  7 

3 

32 

35 

3  1 

3  1 

Total  ASW 

3.22222222 

3,2 

3.3 

3.644444 

3.023222222 

3.03333 

Total  448 
CBSG 

Total  748 

4 

4.1 

4J25 

4  3S 

3.425 

2.9 

CBSG 

Total  848 

28 

3.5 

34 

3.1 

3  1 

2.7 

CBSG 

38 

3  4333333 

3 

3  733333 

1  4 

1  63333 

Total  CSW 

3.53333333 

3,7111111 

3.5419667 

3,727778 

2.641566667 

2A1111 

1 

2 

3 

4 

6 

6 

Summary 

ProciasfT>ent 

Solicitation 

Sointaticn 

Soiara 

ContiacI 

Contract 

Ptanrpg 

Planning 

Setecticin 

Aiftmnistration 

Closeout 

Enterprise 

(OC-ALCyPK) 

2.7 

3 

3 

3.1 

1A 

1.63333 

61 


THIS  PAGE  INTENTIONALLY  LEFT  BLANK 


B2 


APPENDIX  B.  LOA  REStLTS 
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